-- Logs begin at Thu 2022-07-21 20:01:35 UTC, end at Thu 2022-07-21 21:19:46 UTC. -- Jul 21 20:43:05.391088 dv-cinder-850687-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 20:43:05.401288 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 20:43:05 2022] *** Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: nodename: dv-cinder-850687-1-iscsi Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: machine: x86_64 Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: clock source: unix Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: pcre jit disabled Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: detected number of CPU cores: 4 Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: current working directory: / Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: detected binary path: /usr/bin/uwsgi-core Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: your processes number limit is 47680 Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: your memory page size is 4096 bytes Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: detected max file descriptor number: 2048 Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: lock engine: pthread robust mutexes Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: thunder lock: enabled Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 20:43:05.404102 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 20:43:05.449092 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: Python main interpreter initialized at 0x55a16762a9c0 Jul 21 20:43:05.449092 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: python threads support enabled Jul 21 20:43:05.449092 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: your server socket listen backlog is limited to 100 connections Jul 21 20:43:05.449092 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: your mercy for graceful operations on workers is 90 seconds Jul 21 20:43:05.449502 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 20:43:05.449502 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: *** Operational MODE: preforking *** Jul 21 20:43:05.449784 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: *** uWSGI is running in multiple interpreter mode *** Jul 21 20:43:05.449784 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: spawned uWSGI master process (pid: 110045) Jul 21 20:43:05.450039 dv-cinder-850687-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 20:43:05.450822 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: spawned uWSGI worker 1 (pid: 110046, cores: 1) Jul 21 20:43:05.451171 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: spawned uWSGI worker 2 (pid: 110047, cores: 1) Jul 21 20:43:05.451171 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 20:43:06.121061 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 20:43:06.148522 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 20:43:07.251043 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:43:07.251043 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: from cryptography.utils import int_from_bytes Jul 21 20:43:07.251903 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:43:07.251903 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: from cryptography.utils import int_from_bytes Jul 21 20:43:07.296864 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:43:07.296864 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: from cryptography.utils import int_from_bytes Jul 21 20:43:07.297548 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:43:07.297548 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: from cryptography.utils import int_from_bytes Jul 21 20:43:10.274555 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 20:43:10.275246 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 20:43:10.275458 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 20:43:10.275902 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 20:43:10.276278 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 20:43:10.276721 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.277142 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.277519 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.277894 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.278323 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.278696 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.279081 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.279465 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.279878 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.280200 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.280573 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.280953 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850687-1-iscsi {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.281340 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.282048 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.282426 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.282805 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.283175 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.283592 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.283990 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.284554 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.284801 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 20:43:10.285508 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 20:43:10.285642 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.285776 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 20:43:10.285908 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.286076 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 20:43:10.286243 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.286425 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 20:43:10.286690 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.286812 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.287019 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.287319 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.287438 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.287640 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.287805 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.287993 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.288304 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.288401 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.288625 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.288776 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.288946 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.289276 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.289362 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.289534 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.289767 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.289855 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.290163 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850687-1-iscsi {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.290391 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850687-1-iscsi {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.290519 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.290779 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.290935 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.291088 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.291443 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.291622 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.291810 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.291990 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.292138 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.292343 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.292739 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.292916 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.293117 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.293271 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.293419 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.293717 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.293885 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.294064 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.294294 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.294416 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.294637 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.294773 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.294955 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.295226 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.295319 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.295580 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.295706 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.295891 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.296122 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.296316 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850687-1-iscsi {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.296610 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.296706 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.296920 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.297087 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.297221 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.298304 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.298686 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.298834 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.299103 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.299190 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.299458 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.299546 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.299804 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.299980 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.300134 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.300397 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.300532 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.300757 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.300928 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.301073 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.301252 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.301393 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.301715 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.301809 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.302020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.302206 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.302328 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.302642 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.302911 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.303053 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.303195 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.303321 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.303416 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.303538 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.303800 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.303890 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.304108 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.304246 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.304430 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.304705 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.304798 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.305059 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.305148 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.305311 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.305533 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.305627 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.305872 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.305960 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.306190 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.306343 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.306485 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.306766 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.306863 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.307085 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.307180 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.307389 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.307632 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.307789 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.308007 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.308091 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.308310 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.308516 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.308611 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.308918 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.309004 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.309235 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.309372 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.309552 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.309758 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.309845 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.310158 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.310267 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.310554 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.310648 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.310804 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.311045 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.311130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.311436 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.311538 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.311774 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.311978 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.312132 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.312389 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.312481 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.312705 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.312794 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.313259 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.313464 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.313799 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.313939 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.314215 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.314308 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.314562 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.314656 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.314898 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.315059 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.315206 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.315498 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.315615 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.315786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.315981 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.316135 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.316343 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.316467 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.316692 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.316815 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.316997 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.317233 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.317319 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.317591 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.317729 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.317895 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.318157 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.318251 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.318542 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.318638 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.318786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.318982 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.319138 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.319386 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.319532 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.319690 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.319838 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.320016 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.320265 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.320364 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.320625 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.320725 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.320943 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.321097 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.321249 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.321547 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.321632 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.321849 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.322045 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.322154 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.322470 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.322568 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.322775 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.322897 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.323077 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.323328 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.323429 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.323687 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.323815 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.324013 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.324226 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.324314 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.324620 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.324710 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.324922 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.325044 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.325237 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.325468 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.325573 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.325837 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.325988 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.326154 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.326335 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.326467 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.326748 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.326876 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.327049 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.327225 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.327350 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.327651 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.327770 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.327977 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.328159 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.328280 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.329086 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.329256 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.329646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.329933 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.330197 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.330281 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.330579 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.330678 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.330895 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.331056 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.331205 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.331503 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.331599 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.331843 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.331956 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.332181 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.332414 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.332516 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.332814 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.332919 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.333151 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.333288 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.333485 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.333631 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.333819 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.334056 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.334190 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.334434 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.334520 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.334747 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.334912 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.335072 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.335279 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.335384 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.335690 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.335839 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.336025 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.336158 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.336346 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.336597 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.336681 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.336978 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.337081 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.337293 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.337497 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.337609 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.337927 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.338021 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.338238 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.338391 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.338554 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.338831 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:43:10.338917 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.339192 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.339280 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.339502 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.339758 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.339870 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.340208 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.340368 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.340505 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.340664 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.340828 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.341108 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.341201 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.341451 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.341617 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.341767 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.342061 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.342274 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.342408 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.342548 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.342717 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.342956 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.343089 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.343335 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.343466 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.343644 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.343859 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.343979 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.344439 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.344551 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.344902 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.345228 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.345454 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.345582 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.345708 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.345882 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.346154 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.346240 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.346517 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.346658 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.346832 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.347030 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.347224 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.347455 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.347591 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.347785 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.347994 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.348125 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.348392 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.348479 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.348697 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.348883 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.349019 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.349304 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.349450 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.349609 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.349751 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.349928 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.350199 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.350295 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.350551 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.350640 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.350886 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.351048 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.351195 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.351480 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.351579 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.351826 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.352013 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.352138 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.352446 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.352544 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.352760 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.352936 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.353054 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.353365 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.353502 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.353689 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.353824 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.354002 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.354286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.354375 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.354616 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.354705 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.354920 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.355142 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.355229 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.355525 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.355632 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.355864 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.356026 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.356177 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.356462 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.356561 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.356788 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.356878 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.357363 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.357601 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.357694 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.357974 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.358070 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.358309 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.358493 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.358638 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.358920 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.359014 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.359255 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.359349 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.359580 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.359786 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.360478 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.360793 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.361177 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.361375 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.361599 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.361737 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.361993 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.362093 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.362304 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.362485 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.362613 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.362916 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.363001 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.363207 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.363361 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.363518 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.363821 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.363911 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.364149 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.364295 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.364702 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.364848 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.365038 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.365173 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.365529 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.365684 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.365840 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.365981 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.366122 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.366379 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.366543 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.366769 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.366915 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.367084 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.367225 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.367435 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.367748 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.367910 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.368112 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.368278 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.368422 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.368683 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.368834 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.369047 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.369190 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.369364 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.369587 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.369732 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.369985 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.370104 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.370290 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.370613 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.370929 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.371252 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.371565 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.371916 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.372235 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.372559 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.372868 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.373187 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.373724 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.373826 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.373895 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.373993 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.374292 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.374387 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.374626 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.374724 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.375628 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.375773 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.375876 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.375960 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.375960 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.376329 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.376429 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.376651 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.376748 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.376969 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.377195 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.377291 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.377611 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.377773 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.377941 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.378149 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.378237 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.378523 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.378748 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.378835 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.379148 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.379233 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.379469 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.379623 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.379797 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.380114 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.380232 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.380440 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.380564 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.380773 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.381020 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.381120 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.381385 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.381477 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.381711 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.381923 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.382060 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.382321 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.382411 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.382634 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.382829 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.382939 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.383245 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.383347 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.383555 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.383761 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.383888 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.384199 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.384297 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.384510 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.384770 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.384859 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.385117 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.385203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.385427 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.385626 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.385718 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.386024 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.386108 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.386342 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.386547 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.386691 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.386904 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.386990 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.387272 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.387356 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.387594 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.387790 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.388000 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.388187 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.388309 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.388637 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.388734 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.388949 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.389152 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.389237 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.389546 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.389639 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.389850 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.390061 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.390194 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.390521 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.390646 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.390810 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.391004 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.391961 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.392062 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.392450 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.392636 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.392940 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.393036 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.393270 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.393386 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.393589 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.393838 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.393931 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.394220 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.394312 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.394542 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.394686 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.394855 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.395128 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.395431 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.395589 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.395704 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.396026 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.396115 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.396345 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.396531 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.396678 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.396963 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.397038 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.397300 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.397424 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.397615 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.397887 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.397972 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.398234 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.398393 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.398556 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.398915 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.399147 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.399415 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.399499 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.399811 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.399949 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.400137 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.400459 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.400534 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.400808 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.401011 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.401110 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.401439 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.401577 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.401782 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.402089 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.402229 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.402404 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.402676 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.402801 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.403009 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.403240 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.403358 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.403613 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.403839 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.403939 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.404498 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.404579 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.404646 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.404825 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.404940 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.405276 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.405530 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.405616 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.405881 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.406097 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.406202 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.406508 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.406686 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.406871 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.407429 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.407822 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.408040 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.408161 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.408479 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.408597 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.408787 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.409072 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.409157 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.409390 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.409561 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.409739 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.410047 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.410139 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.410392 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.410488 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.410724 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.410928 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.411109 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.411369 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.411488 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.411676 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.411969 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.412086 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.412323 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.412459 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.412631 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.412864 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.413001 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.413234 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.413378 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.413541 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.413777 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.413964 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.414131 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.414287 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.414438 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.414699 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.414827 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.415045 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.415156 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.415349 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.415605 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.415741 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.415979 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.416146 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.416296 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.416605 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.416726 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.416911 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.417073 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.417214 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.417524 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.417637 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.417835 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.418004 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.418126 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.418431 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.418550 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.418735 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.419050 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.419204 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.419385 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.419648 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.419905 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.420022 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.420249 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.420373 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.420569 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.420829 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.420943 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.421194 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.421387 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.421565 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.421776 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.421928 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.422099 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.423079 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.423404 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.423618 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.423904 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.424088 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.424221 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.424524 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.424611 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.424855 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.424965 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.425333 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.425426 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.425643 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.425849 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.425943 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.426257 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.426394 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.426568 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.426713 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.426853 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.427167 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.427260 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.427468 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.427623 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.427797 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.428098 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.428186 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.428407 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.428544 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.428714 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.428975 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.429076 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.429332 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.429417 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.429635 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.429857 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.429956 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.430233 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.430319 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.430577 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.430666 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.430882 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.431105 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.431249 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.431535 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.431623 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.431872 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.432012 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.432197 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.432511 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.432596 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.432827 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.432963 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.433144 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.433445 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.433580 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.433756 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.433910 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.434066 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.434350 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.434439 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.434676 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.434786 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.435099 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.435185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.435439 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.435771 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.436000 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.436135 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.436395 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.436529 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.436723 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.436908 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.437054 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.437342 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.437473 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.437649 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.437813 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.437983 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.438315 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.438722 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.438853 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.439158 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.439245 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.439478 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.439616 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.439846 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.440090 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.440178 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.440463 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.440558 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.440778 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.440929 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.441091 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.441408 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.441558 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.441720 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.441924 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.442073 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.442323 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.442408 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.442649 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.442826 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.442977 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.443256 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.443347 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.443565 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.443814 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.443918 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.444199 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.444291 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.444505 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.444663 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.444944 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.445068 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.445256 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.445502 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.445587 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.445862 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.445949 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.446172 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.446351 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.446483 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.446786 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.446880 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.447098 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.447212 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.447401 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.447666 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.447846 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.448131 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.448233 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.448463 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.448549 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.448773 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.448969 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.449064 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.449375 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.449511 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.449679 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.449892 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.449988 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.450292 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.450377 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.450596 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.450774 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.450899 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.451221 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.451309 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.451524 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.451760 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.451863 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.452230 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.452348 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.452574 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.452659 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.452881 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.453092 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.453296 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.454064 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.454450 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.454610 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.454936 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.455111 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.455390 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.455478 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.455809 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.455973 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.456132 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.456389 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.456500 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.456762 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.456856 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.457074 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.457294 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.457400 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.457719 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.457815 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.458032 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.458157 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.458349 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.458590 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.458680 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.458981 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.459119 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.459299 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.459441 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.459616 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.459921 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.460023 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.460328 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.460415 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.460680 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.460779 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.460993 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.461158 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.461316 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.461600 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.461766 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.461919 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.462135 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.462223 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.462518 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.462684 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.462837 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.463116 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.463219 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.463439 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.463626 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.463843 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.464071 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.464202 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.464384 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.464640 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.464725 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.464982 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.465077 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.465291 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.465499 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.465605 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.465898 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.465986 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.466221 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.466316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.466535 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.466742 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.466857 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.467182 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.467270 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.467489 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.467623 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.467834 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.468084 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.468185 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.468441 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.468526 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.468746 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.468928 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.469051 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.469448 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.469539 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.470007 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.470353 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.470438 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.470683 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.470837 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.471018 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.471279 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.471373 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.471771 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.471897 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.472023 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.472162 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.472357 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.472604 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.472739 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.472984 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.473071 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.473314 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.473471 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.473623 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.473929 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.474033 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.474242 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.474374 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.474548 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.474807 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476026 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476148 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476235 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476315 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476389 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476461 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476542 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476621 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476688 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476688 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476803 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.476866 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.477119 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.477205 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.477444 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.477576 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.477758 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.478004 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.478104 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.478361 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.478509 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.478672 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.478944 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.479030 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.479309 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.479433 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.479647 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.479885 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.480068 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.480304 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.480393 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.480633 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.480729 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.480944 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.481163 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.481258 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.481573 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.481660 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.481903 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.482353 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.482466 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.482785 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.482880 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.483103 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.483281 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.483419 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.483759 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.483851 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.484062 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.484303 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.484445 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.484684 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.485347 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.485712 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.486023 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.486642 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.486742 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.487004 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.487092 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.487337 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.487422 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.487660 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.487911 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.488012 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.488315 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.488399 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.488634 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.488796 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.488950 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.489237 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.489323 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.489576 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.489669 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.489890 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.490114 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.490222 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.490543 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.490637 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.490870 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.490966 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.491209 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.491401 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.491528 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.491873 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.492019 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.492193 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.492355 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.492509 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.492868 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.493011 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.493184 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.493348 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.493492 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.493934 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.494075 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.494174 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.494315 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.494410 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.494743 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.494870 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.495167 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.495257 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.495489 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.495588 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.495828 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.496078 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.496182 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.496439 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.496533 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.496753 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.496945 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.497066 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.497972 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498073 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498142 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498222 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498290 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498363 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498363 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498519 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498607 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.498933 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.499125 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.499467 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.499556 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.499813 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.500003 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.500152 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.500432 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.500621 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.500915 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.501474 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.501577 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.501796 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.501951 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.502123 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.502425 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.502515 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.502761 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.502855 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.503073 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.503393 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.503477 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.503722 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.503929 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.504107 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.504366 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.504487 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.504681 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.504863 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.504989 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.505310 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.505410 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.505623 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.505752 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.506153 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.506238 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.506506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.506608 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.506829 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.507044 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.507159 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.507471 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.507566 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.507819 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.507951 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.508134 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.508410 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.508496 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.508760 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.508855 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.509075 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.509269 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.509393 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.509705 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.509848 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.510013 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.510289 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.510401 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.510622 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.510765 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.510930 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.511235 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.511321 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.511545 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.511734 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.511874 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.512201 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.512287 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.512511 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.512734 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.512820 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.513112 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.513237 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.513426 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.513661 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.513748 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.514021 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.514158 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.514329 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.514576 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.514664 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.514933 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.515017 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.515236 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.515457 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.515543 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.515863 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.515991 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.516929 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.517364 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.517465 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.517714 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.517802 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.518038 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.518248 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.518406 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.518701 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.518787 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.519044 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.519138 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.519359 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.519587 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.519694 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.520046 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.520206 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.520378 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.520657 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.520747 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.521006 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.521143 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.521361 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.521513 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.521682 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.521963 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.522256 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.522401 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.522598 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.522833 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.522936 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.523243 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.523379 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.523578 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.523739 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.523926 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.524188 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.524369 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.524535 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.524765 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.524859 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.525129 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.525243 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.525467 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.525612 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.525782 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.526020 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.526111 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.526393 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.526478 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.526705 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.526845 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.527015 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.527280 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.527374 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.527621 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.527734 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.527953 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.528170 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.528258 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.528560 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.528644 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.528870 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.529050 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.529190 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.529506 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.529592 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.529840 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.529953 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.530156 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.530402 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.530591 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.530781 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.530867 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.531094 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.531292 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.531408 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.531812 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.531960 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.532216 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.532622 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.532750 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.533055 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.533145 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.533394 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.533531 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.533714 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.533983 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.534071 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.534443 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.534593 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.534758 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.534986 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.535127 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.535391 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.535524 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.535704 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.535946 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.536095 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.536357 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.536446 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.536670 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.536854 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.536981 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.537294 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.537426 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.537624 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.537766 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.537965 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.538209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.538306 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.538607 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.538701 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.538915 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.539052 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.539221 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.539501 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.539588 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.539855 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.539944 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.540176 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.540377 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.540471 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.540777 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.540869 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.541079 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.541204 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.541392 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.541645 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.541775 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.541983 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.542070 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.542286 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.542509 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.542603 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.542883 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.542969 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.543184 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.543419 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.543509 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.543793 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.543962 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.544096 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.544393 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.544488 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.544731 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.544910 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.544999 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.545283 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.545377 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.545587 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.545811 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.545897 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.546177 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.546262 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.546477 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.546708 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.546796 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.547127 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.547214 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.548276 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.548576 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.548822 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.548904 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.549215 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.549375 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.549548 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.549829 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.549917 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.550172 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.550257 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.550496 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.550697 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.550818 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.551129 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.551215 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.551468 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.551618 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.551806 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.552052 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.552188 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.552406 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.552513 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.552714 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.552962 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.553052 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.553319 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.553412 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.553646 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.553858 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.553972 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.554280 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.554366 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.554605 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.554785 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.554918 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.555226 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.555526 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.555621 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.555857 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.556021 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.556190 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.556464 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.556595 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.556806 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.556931 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.557112 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.557361 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.557448 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.557720 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.557805 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.558040 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.558193 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.558350 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.558664 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.558781 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.558978 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.559124 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.559292 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.559561 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.559647 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.559954 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.560053 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.560266 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.560476 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.560591 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.560912 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.560999 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.561262 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.561356 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.561575 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.561818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.561912 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.562232 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.562320 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.562545 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.562683 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.562861 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.563274 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.563663 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.563793 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.564034 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 20:43:10.564246 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.564633 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.565080 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.565461 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.565845 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.566226 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.566605 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.566983 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.567362 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.567775 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.568166 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.568558 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.568943 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.569329 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.569724 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.570134 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.570524 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.570909 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.571295 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.571682 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.572301 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.572678 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.573074 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.573526 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.573922 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.574404 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.574786 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.575236 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.575673 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.576077 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.576459 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.576834 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.577212 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.577600 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.577977 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.578348 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.578772 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.579155 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.579794 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.580218 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.580606 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.580996 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.581387 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.581771 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.582208 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.582599 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.582971 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.583343 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.583832 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.584224 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.584622 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.584992 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.585423 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.585798 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.586166 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.586539 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.586939 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.587353 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.587839 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.588221 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.588603 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.588988 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.589375 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.589750 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.590134 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.590509 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.590891 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.591267 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.591650 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.592046 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.592422 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.592790 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.593206 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.593682 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.594087 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.595178 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.595610 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.596040 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.596428 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.596824 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.597210 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.597595 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.598016 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.598407 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.599032 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.599441 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.599867 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.600278 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.600678 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.601052 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.601495 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.601867 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.602258 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.602641 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.603013 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.603389 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.603854 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.604244 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.604619 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.605054 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.605468 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.605877 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.606261 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.606647 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.607279 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.607665 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.608075 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.608482 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.608868 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.609251 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.609636 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.610250 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.610643 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.611023 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.611401 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.611821 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.612209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.612606 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.612988 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.613358 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.613866 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.614256 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.614644 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.615035 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.615480 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.615960 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.616378 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.616760 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.617154 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.617538 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.617938 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.618351 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.618750 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.619147 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.619522 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.619936 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.620310 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.620705 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.621092 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.621467 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.621842 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.622251 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.622634 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.623010 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.623387 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.623794 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.624242 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.624621 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.624992 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.625383 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.626347 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.626863 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.627248 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.627623 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.628031 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.628408 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.628793 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.629167 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.629518 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO dbcounter [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Registered counter for database nova_api Jul 21 20:43:10.629613 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.629941 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.630341 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.630749 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.631139 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.631536 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.631957 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.632348 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.632727 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.633118 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.633508 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.633903 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.634334 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.634738 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.635122 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.635513 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.635955 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.636399 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.636786 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.637270 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.637667 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.638059 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.638432 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.638823 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.639207 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.639752 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.640139 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.640526 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.640923 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.641574 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.642019 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.642450 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.642888 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.643315 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.643787 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.644225 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.644672 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.645101 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.645533 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.645983 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.646423 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.646839 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.647270 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.647704 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.648204 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.648632 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.649084 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.649515 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.649935 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.650427 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.650838 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:43:10.651192 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 20:43:10.715990 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO dbcounter [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Registered counter for database nova_api Jul 21 20:43:10.752701 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:10.759810 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writer thread running {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:10.819915 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.context [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08105eb-bad6-485a-80ad-01afa3fd87ae(cell1) {{(pid=110046) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 20:43:10.823882 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:43:10.825477 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:43:10.826286 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:43:10.826974 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_db.sqlalchemy.engines [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:10.828434 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:43:10.831269 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO dbcounter [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Registered counter for database nova_cell0 Jul 21 20:43:10.833925 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writer thread running {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:10.835234 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO dbcounter [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Registered counter for database nova_cell1 Jul 21 20:43:10.843270 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:10.845321 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:10.850947 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writer thread running {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:10.855994 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writer thread running {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:10.890546 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.context [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08105eb-bad6-485a-80ad-01afa3fd87ae(cell1) {{(pid=110047) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 20:43:10.894788 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_concurrency.lockutils [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:43:10.896387 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_concurrency.lockutils [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:43:10.897179 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_concurrency.lockutils [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:43:10.899283 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_concurrency.lockutils [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:43:10.901293 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO dbcounter [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Registered counter for database nova_cell0 Jul 21 20:43:10.905435 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO dbcounter [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Registered counter for database nova_cell1 Jul 21 20:43:10.913622 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_db.sqlalchemy.engines [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:10.917355 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_db.sqlalchemy.engines [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:10.920250 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writer thread running {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:11.005870 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO dbcounter [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Registered counter for database nova_cell0 Jul 21 20:43:11.014582 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:11.020469 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writer thread running {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:11.060793 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writer thread running {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:11.071737 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO dbcounter [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Registered counter for database nova_cell0 Jul 21 20:43:11.081440 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG oslo_db.sqlalchemy.engines [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:43:11.086077 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writer thread running {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:43:11.369638 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: WARNING keystonemiddleware.auth_token [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:43:11.377220 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: WARNING keystonemiddleware.auth_token [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:43:11.398065 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: WARNING keystonemiddleware.auth_token [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:43:11.405413 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: WARNING keystonemiddleware.auth_token [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:43:11.727053 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: WARNING keystonemiddleware.auth_token [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:43:11.733230 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: WARNING keystonemiddleware.auth_token [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:43:11.739356 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a16762a9c0 pid: 110046 (default app) Jul 21 20:43:11.741461 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:43:11.742649 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jul 21 20:43:11.743053 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Thu Jul 21 20:43:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:43:11.745271 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: WARNING keystonemiddleware.auth_token [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:43:11.751489 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: WARNING keystonemiddleware.auth_token [None req-c15c6a50-e030-4773-8224-5c40ca6ebd53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:43:11.757029 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a16762a9c0 pid: 110047 (default app) Jul 21 20:44:31.827033 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:31.828233 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Jul 21 20:44:31.828644 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:31.840745 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writing DB stats nova_api:SELECT=3 {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:31.841963 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writing DB stats nova_cell0:SELECT=3 {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:31.842697 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writing DB stats nova_cell1:SELECT=3 {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:31.844277 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writing DB stats nova_cell0:SELECT=3 {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:32.770847 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-b7650317-cb7a-4e8a-a84f-02dd585498e1 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:32.805310 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-b7650317-cb7a-4e8a-a84f-02dd585498e1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.969379 Jul 21 20:44:32.812332 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Thu Jul 21 20:44:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:44:35.096737 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:35.098295 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-5f44375d-53e6-4c7e-a60e-76d5fbc61650 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002681 Jul 21 20:44:35.098942 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:35.574501 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-ed862235-73df-4f9c-8e47-e185dce857e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "name": "cirros256"}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:35.594998 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:44:35.594998 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: warnings.warn(msg) Jul 21 20:44:35.626171 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-ed862235-73df-4f9c-8e47-e185dce857e2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521064 Jul 21 20:44:35.626992 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 20:44:35.644243 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_api:SELECT=3 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:35.644243 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_cell0:SELECT=3 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:35.644243 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_cell1:SELECT=3 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:35.644943 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:44:35.854954 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-fdd73664-1c59-4b6e-bc37-73c0de771b23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:35.857407 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:44:35.857407 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:44:35.928851 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-fdd73664-1c59-4b6e-bc37-73c0de771b23 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293828 Jul 21 20:44:35.929673 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Thu Jul 21 20:44:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:44:38.227133 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-ed862235-73df-4f9c-8e47-e185dce857e2 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:38.228193 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-ed862235-73df-4f9c-8e47-e185dce857e2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 21 20:44:38.228780 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:44:38.910992 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-811509dd-f4d4-42db-8869-d991feb9e007 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "vcpus": 1, "disk": 5}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:38.931497 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:44:38.931497 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:44:38.959578 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-811509dd-f4d4-42db-8869-d991feb9e007 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.724491 Jul 21 20:44:38.960293 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:44:38.972352 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-3e5cc6ec-b8e8-4f35-b868-da71c34ab4c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:38.973871 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:44:38.973871 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: warnings.warn(msg) Jul 21 20:44:39.009330 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-3e5cc6ec-b8e8-4f35-b868-da71c34ab4c9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040772 Jul 21 20:44:39.010197 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Thu Jul 21 20:44:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:44:41.412090 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-811509dd-f4d4-42db-8869-d991feb9e007 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:41.413672 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-811509dd-f4d4-42db-8869-d991feb9e007 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001861 Jul 21 20:44:41.414596 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:41.837393 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-6a9ccbc4-4835-4098-b2bb-df950a86a9be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:41.856760 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-6a9ccbc4-4835-4098-b2bb-df950a86a9be admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436181 Jul 21 20:44:41.857303 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:44:41.869560 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-b57a49b4-0204-499d-b2ad-f16669c185ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:41.895935 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-b57a49b4-0204-499d-b2ad-f16669c185ca admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029947 Jul 21 20:44:41.896814 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Thu Jul 21 20:44:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:44:44.143775 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-6a9ccbc4-4835-4098-b2bb-df950a86a9be admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:44.145497 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-6a9ccbc4-4835-4098-b2bb-df950a86a9be admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Jul 21 20:44:44.146315 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:44.573013 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-afe4e64d-9707-4200-a309-17e94f565f20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "ram": 2048}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:44.597430 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-afe4e64d-9707-4200-a309-17e94f565f20 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444491 Jul 21 20:44:44.598935 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:44:44.613165 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-cc813e26-a344-45c1-bbf9-87fdb45396d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:44.641341 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-cc813e26-a344-45c1-bbf9-87fdb45396d0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033107 Jul 21 20:44:44.642316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Thu Jul 21 20:44:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:44:46.927214 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-afe4e64d-9707-4200-a309-17e94f565f20 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:46.928249 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-afe4e64d-9707-4200-a309-17e94f565f20 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 21 20:44:46.932201 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:47.403670 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-9774f4e9-1230-4992-95b1-d31b56f4f6cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "id": "d4", "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:47.422857 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-9774f4e9-1230-4992-95b1-d31b56f4f6cd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488538 Jul 21 20:44:47.423657 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:44:47.435792 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-889d66ad-3fd8-4401-9bca-abd206eb2cf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:47.459038 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-889d66ad-3fd8-4401-9bca-abd206eb2cf8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026980 Jul 21 20:44:47.459764 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Thu Jul 21 20:44:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:44:49.814132 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-9774f4e9-1230-4992-95b1-d31b56f4f6cd admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:49.815257 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-9774f4e9-1230-4992-95b1-d31b56f4f6cd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jul 21 20:44:49.815735 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:50.312405 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-cb50b78e-fcbf-4d66-9c9b-335d2a99e878 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:50.337266 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-cb50b78e-fcbf-4d66-9c9b-335d2a99e878 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.514637 Jul 21 20:44:50.337846 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Thu Jul 21 20:44:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:44:52.720112 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-9774f4e9-1230-4992-95b1-d31b56f4f6cd admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:52.721116 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-9774f4e9-1230-4992-95b1-d31b56f4f6cd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 21 20:44:52.721516 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:53.155655 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-edc2fef1-39cf-449e-9a59-cd912196513c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "1"}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:53.177054 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-edc2fef1-39cf-449e-9a59-cd912196513c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.449331 Jul 21 20:44:53.177752 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 20:44:53.193496 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-1058d40b-739b-48b2-810a-7c60e9cc1d9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:53.219770 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-1058d40b-739b-48b2-810a-7c60e9cc1d9e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030931 Jul 21 20:44:53.220767 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Thu Jul 21 20:44:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:44:55.617700 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-edc2fef1-39cf-449e-9a59-cd912196513c admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:55.618720 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-edc2fef1-39cf-449e-9a59-cd912196513c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 21 20:44:55.619321 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:56.024364 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-5e4400de-2a12-4419-b184-57d56ac0ee5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:56.041512 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-5e4400de-2a12-4419-b184-57d56ac0ee5c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415149 Jul 21 20:44:56.041991 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:44:56.054768 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-8831c37c-d11d-445a-978e-9a6cebf12237 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:56.078630 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-8831c37c-d11d-445a-978e-9a6cebf12237 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027582 Jul 21 20:44:56.079210 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Thu Jul 21 20:44:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:44:58.370412 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-5e4400de-2a12-4419-b184-57d56ac0ee5c admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:44:58.371311 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-5e4400de-2a12-4419-b184-57d56ac0ee5c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 21 20:44:58.371741 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:44:58.754528 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-6603caa7-9bf2-499c-ad6b-49a86de65403 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "vcpus": 2}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:58.773803 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-6603caa7-9bf2-499c-ad6b-49a86de65403 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.395794 Jul 21 20:44:58.774354 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:44:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:44:58.787170 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-a44616b9-47bb-4f53-bd11-92ed63af1758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:44:58.813281 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-a44616b9-47bb-4f53-bd11-92ed63af1758 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029654 Jul 21 20:44:58.813870 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Thu Jul 21 20:44:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:45:01.256266 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-6603caa7-9bf2-499c-ad6b-49a86de65403 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:01.257286 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-6603caa7-9bf2-499c-ad6b-49a86de65403 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jul 21 20:45:01.257692 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:01.716921 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-7b6455de-a805-4aeb-bf84-9aa7c3224445 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "id": "4", "vcpus": 4, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:01.736329 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-7b6455de-a805-4aeb-bf84-9aa7c3224445 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472816 Jul 21 20:45:01.736923 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:45:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:45:01.750791 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-e918699b-64d0-4b7c-bb28-2af9e3b690de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:01.777612 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-e918699b-64d0-4b7c-bb28-2af9e3b690de admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031369 Jul 21 20:45:01.778457 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Thu Jul 21 20:45:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:45:04.240513 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-7b6455de-a805-4aeb-bf84-9aa7c3224445 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:04.241508 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-7b6455de-a805-4aeb-bf84-9aa7c3224445 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Jul 21 20:45:04.243753 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:04.730152 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-26582123-2ba1-4dac-8366-1d620f98726f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "vcpus": 8}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:04.749537 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-26582123-2ba1-4dac-8366-1d620f98726f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.500712 Jul 21 20:45:04.751918 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Thu Jul 21 20:45:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:45:04.763219 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-468b0159-b904-48d9-9136-8d84139f27d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:04.771445 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:45:04.791966 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-468b0159-b904-48d9-9136-8d84139f27d6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032672 Jul 21 20:45:04.800186 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Thu Jul 21 20:45:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:45:24.975697 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-26582123-2ba1-4dac-8366-1d620f98726f admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:24.976729 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-26582123-2ba1-4dac-8366-1d620f98726f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001848 Jul 21 20:45:24.977144 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:45:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:25.376361 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-fc3152f9-f2db-42be-804d-54af3b3a2b66 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:25.392995 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-fc3152f9-f2db-42be-804d-54af3b3a2b66 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409759 Jul 21 20:45:25.393536 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Thu Jul 21 20:45:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:45:26.470759 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-26582123-2ba1-4dac-8366-1d620f98726f admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:26.471797 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-26582123-2ba1-4dac-8366-1d620f98726f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 21 20:45:26.472197 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:27.008398 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-b192b22a-c28d-40e4-aafc-39e33837f1fc admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:27.014471 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.wsgi [None req-b192b22a-c28d-40e4-aafc-39e33837f1fc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-b192b22a-c28d-40e4-aafc-39e33837f1fc admin admin] Request method failure captured: Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Accept: application/json Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Accept-Encoding: gzip, deflate Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Connection: keep-alive Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Content-Length: 0 Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Host: 10.222.0.60 Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Openstack-Api-Version: compute 2.90 Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Openstack-System-Scope: None Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: User-Agent: python-novaclient Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Auth-Token: gAAAAABi2brmcvswgqsxMwn62ZMdhAbG0Oqj04F97hQ6UP09lun7x1XY1FHnfLVNxkqm9C5VFKxrOrRC-YlK-J179_GFf3OMqXmk_Iq8l7rNQtagk0UI9gyizXbeNc82qtflGONSfkQmVwMDW1lHpHdI7_vlmEYT3Vru3BcLw_lnXTIAQ-WXdug Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Domain-Id: None Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Domain-Name: None Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Identity-Status: Confirmed Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Is-Admin-Project: True Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Domain-Id: default Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Domain-Name: Default Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Name: admin Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Role: member,reader,admin Jul 21 20:45:27.017818 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Roles: member,reader,admin Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9f8292e70024a6985791def05952106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9f8292e70024a6985791def05952106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant: admin Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant-Name: admin Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User: admin Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Domain-Id: default Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Domain-Name: Default Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Id: 5ca745bbd8294b9eaae8eb567675a772 Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Name: admin Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: method: > Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: exception: Flavor 42 could not be found. Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: action_args: {'id': '42'} Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:45:27.019203 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:27.020111 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.021373 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-b192b22a-c28d-40e4-aafc-39e33837f1fc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:45:27.022482 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-b192b22a-c28d-40e4-aafc-39e33837f1fc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.404737 Jul 21 20:45:27.022482 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Jul 21 20:45:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 20:45:27.028773 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-33f58435-47ba-4837-8719-112f0436b0ae admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:27.032547 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:45:27.051658 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-33f58435-47ba-4837-8719-112f0436b0ae admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026368 Jul 21 20:45:27.052246 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Jul 21 20:45:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:45:27.062620 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-ae6ad050-56c1-4c79-8cea-852da3e78ff4 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:27.083962 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-ae6ad050-56c1-4c79-8cea-852da3e78ff4 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025457 Jul 21 20:45:27.084508 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Jul 21 20:45:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:45:27.094043 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-54d0709d-6e8d-4f50-9f16-0491764a313a admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:27.099828 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.wsgi [None req-54d0709d-6e8d-4f50-9f16-0491764a313a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-54d0709d-6e8d-4f50-9f16-0491764a313a admin admin] Request method failure captured: Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Accept: application/json Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Accept-Encoding: gzip, deflate Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Connection: keep-alive Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Content-Length: 0 Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Host: 10.222.0.60 Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Openstack-Api-Version: compute 2.90 Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Openstack-System-Scope: None Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: User-Agent: python-novaclient Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Auth-Token: gAAAAABi2brmcvswgqsxMwn62ZMdhAbG0Oqj04F97hQ6UP09lun7x1XY1FHnfLVNxkqm9C5VFKxrOrRC-YlK-J179_GFf3OMqXmk_Iq8l7rNQtagk0UI9gyizXbeNc82qtflGONSfkQmVwMDW1lHpHdI7_vlmEYT3Vru3BcLw_lnXTIAQ-WXdug Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Domain-Id: None Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Domain-Name: None Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Identity-Status: Confirmed Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Is-Admin-Project: True Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Domain-Id: default Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Domain-Name: Default Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Name: admin Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Role: member,reader,admin Jul 21 20:45:27.103130 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Roles: member,reader,admin Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9f8292e70024a6985791def05952106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9f8292e70024a6985791def05952106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant: admin Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant-Name: admin Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User: admin Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Domain-Id: default Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Domain-Name: Default Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Id: 5ca745bbd8294b9eaae8eb567675a772 Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Name: admin Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: method: > Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: exception: Flavor 42 could not be found. Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: action_args: {'id': '42'} Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:45:27.104707 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:27.105563 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:27.107020 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-54d0709d-6e8d-4f50-9f16-0491764a313a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:45:27.108605 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-54d0709d-6e8d-4f50-9f16-0491764a313a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014204 Jul 21 20:45:27.108605 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Jul 21 20:45:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 20:45:28.075902 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-ae6ad050-56c1-4c79-8cea-852da3e78ff4 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:28.076954 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-ae6ad050-56c1-4c79-8cea-852da3e78ff4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 21 20:45:28.077354 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:28.615592 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5cd14873-5a64-4a6b-b33f-bf644a80cbe1 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:28.620999 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.wsgi [None req-5cd14873-5a64-4a6b-b33f-bf644a80cbe1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5cd14873-5a64-4a6b-b33f-bf644a80cbe1 admin admin] Request method failure captured: Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Accept: application/json Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Accept-Encoding: gzip, deflate Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Connection: keep-alive Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Content-Length: 0 Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Host: 10.222.0.60 Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Openstack-Api-Version: compute 2.90 Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Openstack-System-Scope: None Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: User-Agent: python-novaclient Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Auth-Token: gAAAAABi2brn383I59m_Ngd_9UCL6_MKyg24LFygdMYcuIblZTZW2jQNepQ0Rah_U4xHYqZRbY9ruHy1IxSW4vMdru0S9aye9dGixPZilaKkjwVC8yAaiJA3xw0aC_TPM1NahXBuBn2ztoWWiOhmyByjDIAgxtqFmpnjyUZvW9150FLT-5YIMqk Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Domain-Id: None Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Domain-Name: None Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Identity-Status: Confirmed Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Is-Admin-Project: True Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Domain-Id: default Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Domain-Name: Default Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Name: admin Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Role: member,reader,admin Jul 21 20:45:28.622506 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Roles: member,reader,admin Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9f8292e70024a6985791def05952106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9f8292e70024a6985791def05952106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant: admin Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant-Name: admin Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User: admin Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Domain-Id: default Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Domain-Name: Default Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Id: 5ca745bbd8294b9eaae8eb567675a772 Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Name: admin Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: method: > Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: exception: Flavor 84 could not be found. Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: action_args: {'id': '84'} Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:45:28.624908 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:28.626339 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.627786 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5cd14873-5a64-4a6b-b33f-bf644a80cbe1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:45:28.629019 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-5cd14873-5a64-4a6b-b33f-bf644a80cbe1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406333 Jul 21 20:45:28.629019 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Jul 21 20:45:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 20:45:28.634358 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-55207aa0-acf8-4e28-90b0-1d1abb7a0a76 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:28.648486 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-55207aa0-acf8-4e28-90b0-1d1abb7a0a76 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017740 Jul 21 20:45:28.649022 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Jul 21 20:45:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:45:28.658511 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-a27dac34-2b51-4c15-bff1-02878a175986 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:28.672473 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-a27dac34-2b51-4c15-bff1-02878a175986 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017540 Jul 21 20:45:28.672995 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Jul 21 20:45:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:45:28.681980 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-6a5f87aa-75e5-463f-9a58-9c2da21aab76 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:28.688181 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.wsgi [None req-6a5f87aa-75e5-463f-9a58-9c2da21aab76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-6a5f87aa-75e5-463f-9a58-9c2da21aab76 admin admin] Request method failure captured: Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Accept: application/json Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Accept-Encoding: gzip, deflate Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Connection: keep-alive Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Content-Length: 0 Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Host: 10.222.0.60 Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Openstack-Api-Version: compute 2.90 Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Openstack-System-Scope: None Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: User-Agent: python-novaclient Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Auth-Token: gAAAAABi2brn383I59m_Ngd_9UCL6_MKyg24LFygdMYcuIblZTZW2jQNepQ0Rah_U4xHYqZRbY9ruHy1IxSW4vMdru0S9aye9dGixPZilaKkjwVC8yAaiJA3xw0aC_TPM1NahXBuBn2ztoWWiOhmyByjDIAgxtqFmpnjyUZvW9150FLT-5YIMqk Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Domain-Id: None Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Domain-Name: None Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Identity-Status: Confirmed Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Is-Admin-Project: True Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Domain-Id: default Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Domain-Name: Default Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Name: admin Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Role: member,reader,admin Jul 21 20:45:28.689688 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Roles: member,reader,admin Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9f8292e70024a6985791def05952106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9f8292e70024a6985791def05952106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant: admin Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant-Name: admin Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User: admin Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Domain-Id: default Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Domain-Name: Default Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Id: 5ca745bbd8294b9eaae8eb567675a772 Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Name: admin Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: method: > Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: exception: Flavor 84 could not be found. Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: action_args: {'id': '84'} Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:45:28.691201 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:28.692144 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:28.693209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-6a5f87aa-75e5-463f-9a58-9c2da21aab76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:45:28.694362 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-6a5f87aa-75e5-463f-9a58-9c2da21aab76 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012491 Jul 21 20:45:28.694362 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Jul 21 20:45:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 20:45:29.671825 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-a27dac34-2b51-4c15-bff1-02878a175986 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:29.672831 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-a27dac34-2b51-4c15-bff1-02878a175986 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 21 20:45:29.673226 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:30.201344 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-1b1417b0-094c-4836-a50e-633196ff98a3 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:30.207123 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.wsgi [None req-1b1417b0-094c-4836-a50e-633196ff98a3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-1b1417b0-094c-4836-a50e-633196ff98a3 admin admin] Request method failure captured: Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Accept: application/json Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Accept-Encoding: gzip, deflate Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Connection: keep-alive Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Content-Length: 0 Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Host: 10.222.0.60 Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Openstack-Api-Version: compute 2.90 Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Openstack-System-Scope: None Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: User-Agent: python-novaclient Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Auth-Token: gAAAAABi2brpavBNNdem4-ON9I36vNY6hwqC4_dv73gFCzRWGA2zkjL331MwCLZrw_NLwy8_W8vKEFJjF_zd5_dujSV7CqssWegWS5e_NFl8P0FfAN9lRzTgMM526pXLVO-wb1CN9c9SBS-6kC-kYviXYlmdDXgsEiXmUSNS2I2Jm6puTdBxXFM Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Domain-Id: None Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Domain-Name: None Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Identity-Status: Confirmed Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Is-Admin-Project: True Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Domain-Id: default Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Domain-Name: Default Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Project-Name: admin Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Role: member,reader,admin Jul 21 20:45:30.208646 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Roles: member,reader,admin Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9f8292e70024a6985791def05952106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9f8292e70024a6985791def05952106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant: admin Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-Tenant-Name: admin Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User: admin Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Domain-Id: default Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Domain-Name: Default Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Id: 5ca745bbd8294b9eaae8eb567675a772 Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: X-User-Name: admin Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: method: > Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: exception: Flavor 451 could not be found. Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: action_args: {'id': '451'} Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:45:30.210316 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:30.211185 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.212286 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-1b1417b0-094c-4836-a50e-633196ff98a3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:45:30.213313 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-1b1417b0-094c-4836-a50e-633196ff98a3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399932 Jul 21 20:45:30.213313 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:45:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 20:45:30.220186 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-e725d7a9-20d1-420e-b4a6-61c15950571b admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:30.234636 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-e725d7a9-20d1-420e-b4a6-61c15950571b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018540 Jul 21 20:45:30.235327 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Jul 21 20:45:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:45:30.244539 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:30.259304 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018287 Jul 21 20:45:30.259855 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Jul 21 20:45:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:45:30.269207 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5b888bd5-86a6-4d06-a60e-4f5b5229efc1 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:30.274511 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.wsgi [None req-5b888bd5-86a6-4d06-a60e-4f5b5229efc1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5b888bd5-86a6-4d06-a60e-4f5b5229efc1 admin admin] Request method failure captured: Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Accept: application/json Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Accept-Encoding: gzip, deflate Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Connection: keep-alive Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Content-Length: 0 Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Host: 10.222.0.60 Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Openstack-Api-Version: compute 2.90 Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Openstack-System-Scope: None Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: User-Agent: python-novaclient Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Auth-Token: gAAAAABi2brpavBNNdem4-ON9I36vNY6hwqC4_dv73gFCzRWGA2zkjL331MwCLZrw_NLwy8_W8vKEFJjF_zd5_dujSV7CqssWegWS5e_NFl8P0FfAN9lRzTgMM526pXLVO-wb1CN9c9SBS-6kC-kYviXYlmdDXgsEiXmUSNS2I2Jm6puTdBxXFM Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Domain-Id: None Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Domain-Name: None Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Identity-Status: Confirmed Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Is-Admin-Project: True Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Domain-Id: default Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Domain-Name: Default Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Project-Name: admin Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Role: member,reader,admin Jul 21 20:45:30.276031 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Roles: member,reader,admin Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9f8292e70024a6985791def05952106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9f8292e70024a6985791def05952106"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9f8292e70024a6985791def05952106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant: admin Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant-Id: a9f8292e70024a6985791def05952106 Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-Tenant-Name: admin Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User: admin Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Domain-Id: default Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Domain-Name: Default Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Id: 5ca745bbd8294b9eaae8eb567675a772 Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: X-User-Name: admin Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: method: > Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: exception: Flavor 451 could not be found. Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: action_args: {'id': '451'} Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:45:30.277952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:30.278952 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: ERROR nova.api.openstack.wsgi Jul 21 20:45:30.280934 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5b888bd5-86a6-4d06-a60e-4f5b5229efc1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:45:30.282174 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-5b888bd5-86a6-4d06-a60e-4f5b5229efc1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011720 Jul 21 20:45:30.282174 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:45:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 20:45:31.257464 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:31.258498 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 21 20:45:31.258923 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:31.787823 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-5138d697-3573-4c50-8516-47d3f7a5595f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:31.805765 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-5138d697-3573-4c50-8516-47d3f7a5595f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406310 Jul 21 20:45:31.806308 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Jul 21 20:45:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:45:32.801596 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:32.802599 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 21 20:45:32.802996 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:33.334725 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-7f751835-fa10-4fae-a828-234537190569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:33.352807 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-7f751835-fa10-4fae-a828-234537190569 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409457 Jul 21 20:45:33.353380 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Jul 21 20:45:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:45:34.334835 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:34.336106 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jul 21 20:45:34.336535 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:34.866171 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-baf0d919-7fa6-4a48-b13f-be2f3ab84dd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:34.883936 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-baf0d919-7fa6-4a48-b13f-be2f3ab84dd9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.403812 Jul 21 20:45:34.884525 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Jul 21 20:45:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:45:35.883372 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:35.884432 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 21 20:45:35.884823 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:36.419087 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-1baaec2e-f5da-4017-9dd9-9f21124a7f64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:45:36.438220 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-1baaec2e-f5da-4017-9dd9-9f21124a7f64 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414261 Jul 21 20:45:36.438764 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Jul 21 20:45:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:45:37.422397 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:37.423409 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 21 20:45:37.423825 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:45:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:45:37.957088 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-56a32aad-6328-4949-8905-d319548af9ee admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:45:37.977364 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-56a32aad-6328-4949-8905-d319548af9ee admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.413369 Jul 21 20:45:37.977974 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Thu Jul 21 20:45:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:46:30.853538 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:46:30.854533 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-2f00cc82-67ff-4bec-b990-3e89c42f700d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 21 20:46:30.854931 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Thu Jul 21 20:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:46:30.869768 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:46:31.285598 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-55a009bf-ff43-445e-bed3-fff7ad0ef5fd admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:46:31.305417 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-55a009bf-ff43-445e-bed3-fff7ad0ef5fd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441945 Jul 21 20:46:31.305880 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Thu Jul 21 20:46:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:46:31.327219 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG dbcounter [-] [110047] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:46:31.330911 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-9b20b7e0-c174-4f32-beca-87fba6dbb214 admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:46:31.339090 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-9b20b7e0-c174-4f32-beca-87fba6dbb214 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013245 Jul 21 20:46:31.339630 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Thu Jul 21 20:46:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:46:31.352784 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-dee2f0cd-3016-4f28-89db-6dd457690193 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:46:31.365946 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-dee2f0cd-3016-4f28-89db-6dd457690193 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017919 Jul 21 20:46:31.366522 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Thu Jul 21 20:46:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:46:31.379379 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:46:31.388065 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011934 Jul 21 20:46:31.388623 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Thu Jul 21 20:46:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:46:31.400376 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-4fa8fac7-8358-4b4e-a174-3ebddd6b180b admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:46:31.408466 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-4fa8fac7-8358-4b4e-a174-3ebddd6b180b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011755 Jul 21 20:46:31.409018 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Thu Jul 21 20:46:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:50:03.718650 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:03.719734 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 21 20:50:03.720172 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:50:03.870954 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_api:SELECT=6 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:50:04.053990 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-85d1b36f-ab35-4e05-914c-c1defdb58598 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:04.055159 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:50:04.055159 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:50:04.056480 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-85d1b36f-ab35-4e05-914c-c1defdb58598 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:04.056924 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-85d1b36f-ab35-4e05-914c-c1defdb58598 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:04.057815 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-85d1b36f-ab35-4e05-914c-c1defdb58598 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:04.058586 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-85d1b36f-ab35-4e05-914c-c1defdb58598 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:04.098521 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-85d1b36f-ab35-4e05-914c-c1defdb58598 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.229540 Jul 21 20:50:04.099105 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:50:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:50:04.967054 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:04.968115 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 21 20:50:04.968505 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:50:05.164991 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-2f9e13ef-2f2e-4985-af15-4a434a0bf490 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:05.166168 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:50:05.166168 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:50:05.167919 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-2f9e13ef-2f2e-4985-af15-4a434a0bf490 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:05.168518 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-2f9e13ef-2f2e-4985-af15-4a434a0bf490 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:05.169372 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-2f9e13ef-2f2e-4985-af15-4a434a0bf490 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:05.169798 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-2f9e13ef-2f2e-4985-af15-4a434a0bf490 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:05.189798 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-2f9e13ef-2f2e-4985-af15-4a434a0bf490 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082197 Jul 21 20:50:05.190301 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:50:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:50:16.452510 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:16.453592 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 21 20:50:16.454012 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:50:16.606657 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_cell0:SELECT=4 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:50:16.607287 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_cell1:SELECT=4 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:50:16.607921 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_api:SELECT=8 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:50:16.660886 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-1e10346e-5ec0-4e58-8094-d5d9d8ee4703 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:16.662131 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:50:16.662131 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:50:16.663352 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-1e10346e-5ec0-4e58-8094-d5d9d8ee4703 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:16.663815 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-1e10346e-5ec0-4e58-8094-d5d9d8ee4703 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:16.664591 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-1e10346e-5ec0-4e58-8094-d5d9d8ee4703 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:16.665010 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-1e10346e-5ec0-4e58-8094-d5d9d8ee4703 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:16.685176 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-1e10346e-5ec0-4e58-8094-d5d9d8ee4703 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083144 Jul 21 20:50:16.685754 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:50:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:50:17.550612 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:17.551700 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 21 20:50:17.552209 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:50:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:50:17.762858 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-d86a6399-8356-48ed-a381-a349681cfd78 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:17.765262 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:50:17.765262 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:50:17.768471 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-d86a6399-8356-48ed-a381-a349681cfd78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:17.769542 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-d86a6399-8356-48ed-a381-a349681cfd78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:17.771523 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-d86a6399-8356-48ed-a381-a349681cfd78 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:17.772234 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-d86a6399-8356-48ed-a381-a349681cfd78 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:17.803437 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-d86a6399-8356-48ed-a381-a349681cfd78 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.106924 Jul 21 20:50:17.804109 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:50:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:50:29.023547 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:29.024575 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 21 20:50:29.024974 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 38/77] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:50:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:50:29.174653 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_cell0:SELECT=4 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:50:29.175816 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_cell1:SELECT=4 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:50:29.176872 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG dbcounter [-] [110046] Writing DB stats nova_api:SELECT=8 {{(pid=110046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:50:29.229931 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-0021ad68-ce72-4336-be5d-00c63c78fae0 admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:29.230970 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:50:29.230970 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:50:29.232180 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-0021ad68-ce72-4336-be5d-00c63c78fae0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:29.232610 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-0021ad68-ce72-4336-be5d-00c63c78fae0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:29.233385 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-0021ad68-ce72-4336-be5d-00c63c78fae0 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:29.233801 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-0021ad68-ce72-4336-be5d-00c63c78fae0 admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:29.255989 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-0021ad68-ce72-4336-be5d-00c63c78fae0 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089853 Jul 21 20:50:29.256717 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 40/78] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:50:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:50:30.095345 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: DEBUG nova.api.openstack.wsgi [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] Calling method '>' {{(pid=110047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:30.096378 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: INFO nova.api.openstack.requestlog [None req-85ad2d8b-8600-4aa4-bf46-e192ee91754e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 21 20:50:30.096782 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: [pid: 110047|app: 0|req: 39/79] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Jul 21 20:50:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:50:30.295276 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG nova.api.openstack.wsgi [None req-7dd0e1a0-f012-4277-abdd-9667575e910f admin admin] Calling method '>' {{(pid=110046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:50:30.296615 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 20:50:30.296615 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: warnings.warn(msg) Jul 21 20:50:30.297876 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-7dd0e1a0-f012-4277-abdd-9667575e910f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:30.298314 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-7dd0e1a0-f012-4277-abdd-9667575e910f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:30.299126 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-7dd0e1a0-f012-4277-abdd-9667575e910f admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:50:30.299553 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: DEBUG oslo_concurrency.lockutils [None req-7dd0e1a0-f012-4277-abdd-9667575e910f admin admin] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:50:30.322088 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: INFO nova.api.openstack.requestlog [None req-7dd0e1a0-f012-4277-abdd-9667575e910f admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083300 Jul 21 20:50:30.322666 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: [pid: 110046|app: 0|req: 41/80] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Jul 21 20:50:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:51:35.216250 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: Thu Jul 21 20:51:35 2022 - graceful shutdown triggered... Jul 21 20:51:35.215632 dv-cinder-850687-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 20:51:35.217335 dv-cinder-850687-1-iscsi devstack@n-api.service[110046]: Gracefully killing worker 1 (pid: 110046)... Jul 21 20:51:35.219473 dv-cinder-850687-1-iscsi devstack@n-api.service[110047]: Gracefully killing worker 2 (pid: 110047)... Jul 21 20:51:36.215871 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: worker 1 buried after 1 seconds Jul 21 20:51:36.216169 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: worker 2 buried after 1 seconds Jul 21 20:51:36.216169 dv-cinder-850687-1-iscsi devstack@n-api.service[110045]: goodbye to uWSGI. Jul 21 20:51:36.217765 dv-cinder-850687-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 20:51:36.218331 dv-cinder-850687-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 20:51:36.221281 dv-cinder-850687-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 20:51:36.231010 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 20:51:36.233868 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 20:51:36 2022] *** Jul 21 20:51:36.234036 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 20:51:36.234169 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 20:51:36.234282 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: nodename: dv-cinder-850687-1-iscsi Jul 21 20:51:36.234389 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: machine: x86_64 Jul 21 20:51:36.234504 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: clock source: unix Jul 21 20:51:36.234617 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: pcre jit disabled Jul 21 20:51:36.234724 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: detected number of CPU cores: 4 Jul 21 20:51:36.234830 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: current working directory: / Jul 21 20:51:36.234948 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: detected binary path: /usr/bin/uwsgi-core Jul 21 20:51:36.235063 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: your processes number limit is 47680 Jul 21 20:51:36.235172 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: your memory page size is 4096 bytes Jul 21 20:51:36.235287 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: detected max file descriptor number: 2048 Jul 21 20:51:36.235396 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: lock engine: pthread robust mutexes Jul 21 20:51:36.235959 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: thunder lock: enabled Jul 21 20:51:36.236284 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 20:51:36.236532 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 20:51:36.282663 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: Python main interpreter initialized at 0x5595963289c0 Jul 21 20:51:36.282663 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: python threads support enabled Jul 21 20:51:36.282663 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: your server socket listen backlog is limited to 100 connections Jul 21 20:51:36.282663 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: your mercy for graceful operations on workers is 90 seconds Jul 21 20:51:36.283134 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 20:51:36.283134 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: *** Operational MODE: preforking *** Jul 21 20:51:36.283405 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: *** uWSGI is running in multiple interpreter mode *** Jul 21 20:51:36.283405 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: spawned uWSGI master process (pid: 124631) Jul 21 20:51:36.283621 dv-cinder-850687-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 20:51:36.285115 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: spawned uWSGI worker 1 (pid: 124646, cores: 1) Jul 21 20:51:36.285115 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: spawned uWSGI worker 2 (pid: 124647, cores: 1) Jul 21 20:51:36.285115 dv-cinder-850687-1-iscsi devstack@n-api.service[124631]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 20:51:36.969773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 20:51:36.982769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 20:51:38.209470 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:51:38.209470 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: from cryptography.utils import int_from_bytes Jul 21 20:51:38.210242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:51:38.210242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: from cryptography.utils import int_from_bytes Jul 21 20:51:38.229143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:51:38.229143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: from cryptography.utils import int_from_bytes Jul 21 20:51:38.229751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 20:51:38.229751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: from cryptography.utils import int_from_bytes Jul 21 20:51:40.609741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 20:51:40.610307 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 20:51:40.610541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 20:51:40.611161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 20:51:40.611422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 20:51:40.611849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.612182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.612507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.612819 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.613156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.613471 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.613798 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.614122 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.614455 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.614727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.615046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.615373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850687-1-iscsi {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.615700 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.616033 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.616351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.616682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.616990 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.617314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.617619 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.618137 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.618591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.618903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.619218 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.619561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.619922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.620228 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.620544 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.621404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.621754 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.622062 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.622475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850687-1-iscsi {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.622799 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.623131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.623438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.624469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.624469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.624673 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.624874 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.625149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.625464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.625793 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.626116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.626440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.626764 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.627075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.627389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.627784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.628073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.628382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.628691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.629028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.629263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.629589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.629915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.630252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.630677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.630832 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.631059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.631388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.631701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.632041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.632353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.632668 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.632980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.633294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.633605 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.633919 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.634241 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.634568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.634896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.635223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.635536 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.635975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.636229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.637346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.637529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.637825 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.638240 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.638617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.638948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.639271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.639584 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.639926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.640251 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.640596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.640941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.641276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.641582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.641874 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.642202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.642519 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.642833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.643146 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.643449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.643781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.644096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.644409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.644722 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.645032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.645342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.645653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.645964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.646275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.646601 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.646927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.647240 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.647553 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.647895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.648211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.648542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.648857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.649172 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.649498 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.649814 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.650125 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.650450 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.650764 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.651075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.651401 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.651746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.652143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.652396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.652712 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.653121 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.653434 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.653748 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.654060 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.654371 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.654681 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.654993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.655299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.655624 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.655978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.656295 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.656606 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.656918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.657246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.657592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.657937 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.658291 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.658612 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.658956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.659292 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.659616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.659958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.660280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.660612 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.660930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.661246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.661563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.661887 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.662252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.662545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.662867 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663634 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.663858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.669556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.669556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.669556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.669556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.669556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.669556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.669556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.670417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.670417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.670561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.670823 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.671317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.671842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.672987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.673569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.673906 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.674264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.674563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.675075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.675405 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.675749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.676072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.676392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.677167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.677167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.677446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.677804 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.677969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.678271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.678746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.678918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.679337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.679535 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.679893 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.680212 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.680525 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.680854 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.681532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.681532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.681805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.682099 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.682413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.682743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.683055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.683739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.683739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.684081 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.684589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.684750 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.685050 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.685415 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.685763 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.686145 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.686494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.686935 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.687305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.687813 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.688111 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.688438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.688755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.689072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.689387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.689699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.690014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.690328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.690653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.690949 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.691261 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.691570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.691904 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.692234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.692550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.692863 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.693171 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.693480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.693834 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.694143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.694494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.694836 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.695161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.695510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.695830 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.696151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.696467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.696787 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.697105 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.697425 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.697749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.698070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.698394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.698710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.699564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.699905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.700253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.700540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.700868 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.701210 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.701551 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.701879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.702215 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.702524 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.702849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.703164 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.703476 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.704718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.704718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.704718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.704718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.705614 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.705614 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.706080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.706080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.706511 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.706737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.706960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.707202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.707521 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.707861 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.708189 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.708517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.708833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.709150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.709465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.709902 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.710150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.710373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.710674 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.710987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.711301 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.711610 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.712001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.712271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.712813 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.713003 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.713219 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.713516 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.713835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.714158 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.714604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.714958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.715184 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.715568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.715930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.716211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.716523 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.716859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.717182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.717499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.717814 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.718148 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.718477 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.718793 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.719118 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.719435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.719769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.720102 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.720526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.721179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.721179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.721332 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.721644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.722280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.722280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.722682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.722984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.723202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.723510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.723848 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.724170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.724940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.725184 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.725412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.725739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.726063 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.726392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.726727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.727061 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.727403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.727740 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.728056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.728368 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.728680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.728997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.729308 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.729620 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.729931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.730892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.731338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.731667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.732001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.732319 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.732644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.732956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.733275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.733586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.733917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.734233 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.734543 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.734853 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.735162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.735511 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.736165 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.736444 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.736783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.737127 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.737439 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.737749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.738079 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.738390 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.738705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.739016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.739331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.739646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.739982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.740302 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.740619 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.740933 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.741247 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.741557 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.741869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.742182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.742505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.742814 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.743135 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.743441 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.743757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.744075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.744382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.744695 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.745000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.745320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.745645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.746508 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.747393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.748001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.748175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.748846 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.749192 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.749514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.749831 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.750145 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.750465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.750779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.751091 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.751410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.751996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.752188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.752381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.752699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.753011 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.753639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.753639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.753964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.754228 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.754534 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.754843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.755158 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.755467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.756010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.756368 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.756517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.756718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.757028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.757383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.757693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.758134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.758366 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.758685 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.759012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.759337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.759653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.760002 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.760311 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.760633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.760952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.761340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.761796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.762118 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.762450 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.762770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.763086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.763414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.763762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.764096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.764407 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.764724 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.765041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.765358 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.765671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.766066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.766301 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.766620 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.766939 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.767253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.767568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.767907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.768224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.768542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.768738 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 20:51:40.769179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.769179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.769467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.769572 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 20:51:40.769775 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.770001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 20:51:40.770102 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.770372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 20:51:40.770472 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.770630 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 20:51:40.770736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.770982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.771428 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.771765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.772081 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.772397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.772710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.773028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.773348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.773672 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.773994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.774403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.774796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.775038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.775353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.775663 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.775994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.776312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.776639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.776972 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.777369 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.777520 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.777643 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.777803 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.777941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.778149 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.778242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.781920 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.782121 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.782258 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.782376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.782673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.782816 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.782816 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.782964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.782964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.783100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.783179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.783273 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.783438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.783438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.783617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.783733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850687-1-iscsi {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.783733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.784017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.784129 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.784129 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.784440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.784567 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.784677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.784795 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.784906 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.785078 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.785198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.785321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.785430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.785430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.785663 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.785784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.785784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.785967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.786059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.786059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.786059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.786059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.786352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.786429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.786718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.786814 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.787043 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.787134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.787557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.787652 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.787776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.787952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.788107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.788189 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.788420 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.788507 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.788734 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.788829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.789051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.789134 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.789681 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.791092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850687-1-iscsi {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.791092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.791092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.791092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.791426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.791649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.791976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.792357 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.793202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.793582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.794011 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.794262 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.794594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.794921 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.795244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.795244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.795244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.798041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.798306 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.798492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.798669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.798669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.798669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.799112 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.799292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.799684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.799963 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.800206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.800365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.800526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.800691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.800859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.801009 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.801009 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.801336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.801593 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.801773 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.801928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.802208 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.802365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.802530 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.802681 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.802681 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.802992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.803158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.803158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.803615 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.803805 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.803805 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.803805 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.804242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.804401 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.804566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.804716 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.804716 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.805008 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.805199 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.805199 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.805559 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.805718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.805882 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.806082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.806082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.806412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.806611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.806814 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.806966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.806966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.807268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.807452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.807452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.809117 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.809274 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.809423 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.809592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.809592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.809592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.810258 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.810418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.810418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.810713 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.810875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.810875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.811190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.811348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.811348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.811640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.811814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.811814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.812120 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.812398 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.812554 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.812721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.812721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.813016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.813166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.813166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.813467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.813650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.813650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.814072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.814232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.814232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.814524 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.814683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.814683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.814975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.815124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.815284 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.815442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.815442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.815780 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.815937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.816098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.816247 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.816247 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.816541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.816689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.816689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.816981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.817130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.817297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.817447 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.817447 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.817762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.818111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.818111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.818111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.818549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.818707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.818871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.819027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.819027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.819337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.819553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.819553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.820161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.820368 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.820529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.820718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.820718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.821140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.821298 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.821298 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.821607 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.821757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.821905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.822075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.822075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.822378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.822643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.822643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.822952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.823118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.823118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.823417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.823576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.823576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.823960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.824265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 20:51:40.824430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.824582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.824731 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.824888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.825052 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.825209 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.825452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.825610 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.825798 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.826041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.826213 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.826454 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.826764 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.826923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.827080 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.827406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.827592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.827787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.828197 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.828366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.828366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.828667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.828818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.828974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.829178 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.829351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.829561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.829804 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.829959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.830298 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.830455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.830606 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.830762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.830923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.831074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.831223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.831476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.831644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.831877 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.832155 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.832510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.832829 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.833016 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.833209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.833415 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.833620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.833812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.834011 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.834191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.834526 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.834526 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.834855 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.835019 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.835171 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.835329 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.835480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.835637 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.835831 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.835986 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.836147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.836297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.836453 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.836616 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.836778 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.836936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.837086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.837244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.837402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.837652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.837652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.837959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.838117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.838440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.838679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.838833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.838993 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.839142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.839291 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.839477 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.839651 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.839869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.840019 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.840180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.840513 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.840513 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.840817 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.840817 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.841124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.841274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.841432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.841595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.841744 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.841892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.842040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.842188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.842345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.842504 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.842661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.842836 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.843140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.843140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.843507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.843677 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.843875 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.844036 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.844194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.844353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.844535 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.844811 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.845016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.845204 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.845377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.845548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.845710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.845928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.846134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.846318 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.846318 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.846670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.846832 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.846982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.847140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.847299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.847457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.847457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.847997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.848245 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.848245 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.848839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.849008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.849008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.849008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.849008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.849008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.849008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.850012 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.850012 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.850417 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.850989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.851842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.851842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.852218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.852416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.852718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.853300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.853884 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.854258 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.854680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.855908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.856255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.856740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.857118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.857700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.858500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.858500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.859079 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.859079 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.859582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.860130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.860456 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.861075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.861493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.861983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.862328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.862656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.862988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.864032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.864032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.864736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.864736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.865260 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.865487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.865704 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.865965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.866304 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.866472 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.866657 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.867008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.867174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.867336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.867645 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.867916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.868083 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.868326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.868511 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.868778 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.869105 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.869271 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.869440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.869611 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.869769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.869920 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.870148 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.870316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.870520 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.870677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.871562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.871771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.871940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.872110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.872262 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.872429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.872588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.872755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.872918 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.873081 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.873239 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.873421 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.873676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.873852 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.874011 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.874187 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.874345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.874505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.874671 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.875402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.875588 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.875782 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.875782 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.876086 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.876241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.876396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.876565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.876726 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.876882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.877042 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.877198 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.877371 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.877534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.877684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.877844 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.878114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.878271 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.878429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.878593 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.878799 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.879261 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.879261 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.879568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.879764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.879944 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.880104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.880278 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.880436 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.880436 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.880749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.880900 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.881057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.881216 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.881373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.881542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.881880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.882050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.882208 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.882366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.882517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.882718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.882964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.883128 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.883291 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.883442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.883601 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.883897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.884066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.884224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.884393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.884551 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.884701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.884859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.885016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.885177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.885335 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.885512 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.885782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.885954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.885954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.886259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.886457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.886457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.886782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.886945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.886945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.887246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.887404 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.887404 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.887698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.887926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.888107 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.888356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.888356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.888665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.888835 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.888835 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.889262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.889644 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.889644 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.889943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.890111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.890111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.890406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.890560 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.890784 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.891106 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.891890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.892081 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.892386 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.892713 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.893042 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.893367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.893710 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.894048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.894224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.894387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.894695 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.894867 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.895031 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.895308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.895465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.895616 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.895886 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.896162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.896321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.896485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.896645 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.896795 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.896945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.897101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.897250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.897413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.897582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.897733 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.897891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.898141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.898323 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.898581 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.898746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.898898 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.899056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.899231 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.899705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.900540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.900714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.900714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.901030 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.901182 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.901360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.901585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.901585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.901909 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.902360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.902523 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.902689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.902689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.902689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.903346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.903500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.903500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.903826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.903982 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.903982 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.904411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.904571 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.904571 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.904873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.905954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.906392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.906550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.906718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.906869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.906869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.907160 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.907316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.907316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.907651 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.907849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.908029 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.908189 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.908349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.908596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.908861 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.908861 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.909161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.909322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.909491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.909977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.910148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.910148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.910440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.910597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.910762 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.910921 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.911072 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.911232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.911390 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.911562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.911843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.912004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.912373 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.912553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.912713 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.912873 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.913065 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.913230 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.913382 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.913656 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.913824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.913981 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.914327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.914500 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.914650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.914869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.915036 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.915187 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.915495 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.915654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.915906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.916059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.916215 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.916517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.916689 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.916849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.917012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.917185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.917436 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.918802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.918802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.919644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.920362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.920536 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.920693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.920857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.921011 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.921172 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.921323 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.921472 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.921637 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.921849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.922054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.922254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.922639 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.922639 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.923025 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.923224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.923427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.923583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.923789 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.923960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.924123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.924123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.924552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.924552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.924864 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.925024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.925189 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.925349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.925510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.925661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.925661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.925958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.926118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.926276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.926438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.926438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.926899 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.927082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.927082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.927385 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.927542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.927542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.927875 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.928037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.928037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.928340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.928497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.928497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.928801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.928959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.929108 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.929263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.929263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.929685 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.929845 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.929845 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.930458 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.930628 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.930788 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.930945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.930945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.931275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.931426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.931426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.931752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.931922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.932084 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.932243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.932243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.932554 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.932926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.932926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.934141 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.934351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.934684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.934955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.934955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.935267 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.935418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.935418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.935736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.935895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.936056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.936221 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.936221 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.936221 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.936675 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.937025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.937188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.937349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.937349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.937650 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.937807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.937807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.938118 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.938277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.938277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.938569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.938740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.938740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.939050 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.939208 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.939367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.939544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.939544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.939544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.940163 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.940628 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.940786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.940937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.940937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.941233 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.941395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.941395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.941728 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.941891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.941891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.942190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.942348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.942498 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.942645 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.943005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.943162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.943332 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.943483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.943633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.943818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.944032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.944190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.944355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.944506 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.944664 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.944825 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.945085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.945243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.945478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.945642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.945799 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.945949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.946105 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.946256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.946416 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.946574 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.946574 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.946858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.947014 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.947311 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.947478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.947629 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.947829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.947984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.948141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.948305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.948457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.948613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.948764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.948963 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.949115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.949315 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.949489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.949650 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.949834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.950119 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.950331 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.950811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.950980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.951138 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.951138 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.951440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.951609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.951813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.951982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.952142 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.952305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.952460 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.952620 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.952770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.952944 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.953300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.953452 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.953617 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.953768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.953917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.953917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.954201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.954358 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.954532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.954683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.954841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.954999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.955257 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.955421 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.955583 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.955761 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.955930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.956082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.956231 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.956379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.956542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.956711 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.956862 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.957020 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.957020 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.957341 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.957622 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.957779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.957779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958070 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958228 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.958394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.959656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.959656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.959656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.959656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.960610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.960610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.960610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.961464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.961464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.961464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.961913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.962063 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.962281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.962591 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.962902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.963316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.964216 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.964216 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.964567 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.964865 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.965192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.965507 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.965834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.966153 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.966466 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.966777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.967088 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.967444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.967869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.968143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.968471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.968799 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.969136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.969457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.969788 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.970110 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.970459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.970749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.971271 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.971443 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.971693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.972038 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.972359 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.972682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.973004 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.973472 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.973917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.974262 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.974594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.974916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.975372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.975568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.976001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.976326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.976648 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.976969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.977290 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.977640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.978057 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.978309 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.978657 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.978987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.979310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.979634 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.980006 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.981290 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.981290 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.981813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.981978 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.982145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.982474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.982794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.983117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.983615 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.983914 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.984084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.984407 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.984727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.985052 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.985395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.986284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.986517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.986756 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.986989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.987246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.987879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.988183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.988618 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.988862 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.989169 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.989496 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.989823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.990160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.990474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.990784 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.991121 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.991857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.991857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.992310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.992565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.992929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.993308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.993308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.994236 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.994236 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.994708 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.994976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.995255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.995497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.996648 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.996648 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.996648 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.997367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.997367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.997367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.998060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.998060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.998521 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.998521 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.998994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.999464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.999464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:40.999954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.000194 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.000434 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.000675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.000952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.001276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.001655 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.002073 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.002234 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.002462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.002770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.003082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.003388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.003700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.004125 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.004340 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.004705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.005043 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.005361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.005668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.005993 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.006313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.006916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.006916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.007395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.007647 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.008117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.008514 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.008851 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.009179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.009650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.009892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.010141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.010460 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.010773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.011109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.012499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.012499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.012981 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.012981 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.013618 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.013618 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.014399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.014399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.014399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.015122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.015122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.015620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.015620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.016144 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.016387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.016625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.016886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.017544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.017544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.018001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.018226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.018510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.018742 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.019023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.019365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.019665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.020147 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.020431 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.020750 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.021074 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.021402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.021720 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.022049 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.022584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.022770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.023003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.023403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.023654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.024037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.025420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.025420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.025420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.025420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.026072 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.026072 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.026368 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.026530 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.026813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.027180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.027651 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.027939 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.028253 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.028566 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.028880 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.029200 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.029509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.029818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.030220 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.030431 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.030739 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.031048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.031923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.031923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.032233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.032538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.032933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.032933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.033235 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.033741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.033910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.034218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.034550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.034869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.035186 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.035605 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.035870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.036199 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.036516 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.036860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.037177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.037587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.037908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.038115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.038433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.038753 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.039100 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.039432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.039769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.040108 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.040474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.040759 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.041084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.041402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.041741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.042060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.042379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.042731 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.043145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.043339 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.043661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.044000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.044318 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.044641 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.044964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.045300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.045758 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.045935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.046322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.046723 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.047085 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.047406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.048160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.048160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.048427 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.048721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.049031 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 20:51:41.049280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 20:51:41.117818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO dbcounter [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Registered counter for database nova_api Jul 21 20:51:41.141488 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_db.sqlalchemy.engines [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.148915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writer thread running {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.209617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.context [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08105eb-bad6-485a-80ad-01afa3fd87ae(cell1) {{(pid=124647) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 20:51:41.209849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO dbcounter [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Registered counter for database nova_api Jul 21 20:51:41.213638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:51:41.215262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:51:41.216179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:51:41.218202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:51:41.221018 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO dbcounter [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Registered counter for database nova_cell0 Jul 21 20:51:41.224574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO dbcounter [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Registered counter for database nova_cell1 Jul 21 20:51:41.230118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_db.sqlalchemy.engines [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.232782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_db.sqlalchemy.engines [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.233642 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_db.sqlalchemy.engines [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.239564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writer thread running {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.242201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writer thread running {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.242326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writer thread running {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.304056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.context [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08105eb-bad6-485a-80ad-01afa3fd87ae(cell1) {{(pid=124646) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 20:51:41.308791 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:51:41.310416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:51:41.311257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:51:41.313314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:51:41.315357 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO dbcounter [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Registered counter for database nova_cell0 Jul 21 20:51:41.319489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO dbcounter [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Registered counter for database nova_cell1 Jul 21 20:51:41.327624 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_db.sqlalchemy.engines [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.329059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_db.sqlalchemy.engines [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.335893 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writer thread running {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.337190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writer thread running {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.393280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO dbcounter [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Registered counter for database nova_cell0 Jul 21 20:51:41.400246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_db.sqlalchemy.engines [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.405812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writer thread running {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.496509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO dbcounter [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Registered counter for database nova_cell0 Jul 21 20:51:41.512117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_db.sqlalchemy.engines [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 20:51:41.531672 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writer thread running {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 20:51:41.758623 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: WARNING keystonemiddleware.auth_token [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:51:41.766051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: WARNING keystonemiddleware.auth_token [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:51:41.876694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: WARNING keystonemiddleware.auth_token [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:51:41.883951 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: WARNING keystonemiddleware.auth_token [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:51:42.114967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: WARNING keystonemiddleware.auth_token [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:51:42.121833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: WARNING keystonemiddleware.auth_token [None req-06a0ccb1-d6f7-438c-9604-8e286fc4e54f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:51:42.128414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595963289c0 pid: 124647 (default app) Jul 21 20:51:42.234988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: WARNING keystonemiddleware.auth_token [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 20:51:42.241500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: WARNING keystonemiddleware.auth_token [None req-0f3752aa-07e4-433d-887d-54bd74b8a710 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 20:51:42.248278 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595963289c0 pid: 124646 (default app) Jul 21 20:52:24.513349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:24.514723 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:24.515592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:24.516606 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:25.600077 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:25.600954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:25.601919 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:25.605216 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:25.957195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-09a3e6bf-1e20-4d2b-9d25-651aa0abcc16 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Action: 'create', calling method: .version_select at 0x7f35421c8ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1251523530", "metadata": {"Type": "work"}}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:27.154795 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b7506df7-2a37-448f-a3fb-17740ab33a12 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Action: 'create', calling method: .version_select at 0x7f35421c8ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-778083460", "metadata": {"Type": "work"}}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b7506df7-2a37-448f-a3fb-17740ab33a12 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Request method failure captured: Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 121 Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byJ41TdQS787qWH7UvDKQsFf7XomT8RYpEoOCjLI_Jn4eaHpsxFzXUweMiKlIlyD3d1E_nhxaumNxGowKFGq2Az7io_Dg7a4gkclLVST94m5b4lHIDHWBbkThrdZP9kAGg4xzzewPUcZqJbyGq7eWFuEZVLqIt8C0HxWF6dzCbZw8A Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:52:27.171705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab080027ba304297bd7a63d546b2bd61 Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-778083460", "metadata": {"Type": "work"}}} Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 20:52:27.173114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-778083460', 'metadata': {'Type': 'work'}}}} Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise error Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:52:27.173936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 20:52:27.175246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 20:52:27.178230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 20:52:27.178230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.178230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b7506df7-2a37-448f-a3fb-17740ab33a12 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:52:27.178230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b7506df7-2a37-448f-a3fb-17740ab33a12 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.579521 Jul 21 20:52:27.182797 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Thu Jul 21 20:52:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1587 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:52:27.194806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2acf305b-9690-470b-9cff-1e787c3ad249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Action: 'create', calling method: .version_select at 0x7f35420e9f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1213482350", "metadata": {"Type": "work"}}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2acf305b-9690-470b-9cff-1e787c3ad249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Request method failure captured: Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 120 Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byJ41TdQS787qWH7UvDKQsFf7XomT8RYpEoOCjLI_Jn4eaHpsxFzXUweMiKlIlyD3d1E_nhxaumNxGowKFGq2Az7io_Dg7a4gkclLVST94m5b4lHIDHWBbkThrdZP9kAGg4xzzewPUcZqJbyGq7eWFuEZVLqIt8C0HxWF6dzCbZw8A Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:52:27.201584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab080027ba304297bd7a63d546b2bd61 Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1213482350", "metadata": {"Type": "work"}}} Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 20:52:27.202942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1213482350', 'metadata': {'Type': 'work'}}}} Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise error Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi '0' Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:52:27.203820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 20:52:27.205205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 20:52:27.209764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 20:52:27.209764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.209764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2acf305b-9690-470b-9cff-1e787c3ad249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:52:27.209764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2acf305b-9690-470b-9cff-1e787c3ad249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018996 Jul 21 20:52:27.224822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 2/2] 10.222.0.60 () {60 vars in 1155 bytes} [Thu Jul 21 20:52:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:52:27.246491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b73c93ac-2fd0-47cd-9367-36726603b249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Action: 'create', calling method: .version_select at 0x7f35420e90d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1882393842", "metadata": {"Type": "work"}}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b73c93ac-2fd0-47cd-9367-36726603b249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Request method failure captured: Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 119 Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byJ41TdQS787qWH7UvDKQsFf7XomT8RYpEoOCjLI_Jn4eaHpsxFzXUweMiKlIlyD3d1E_nhxaumNxGowKFGq2Az7io_Dg7a4gkclLVST94m5b4lHIDHWBbkThrdZP9kAGg4xzzewPUcZqJbyGq7eWFuEZVLqIt8C0HxWF6dzCbZw8A Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:52:27.248938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab080027ba304297bd7a63d546b2bd61 Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1882393842", "metadata": {"Type": "work"}}} Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 20:52:27.250575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1882393842', 'metadata': {'Type': 'work'}}}} Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise error Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi '' Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:52:27.251312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 20:52:27.252613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 20:52:27.253671 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 20:52:27.253671 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:27.255613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b73c93ac-2fd0-47cd-9367-36726603b249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:52:27.256599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b73c93ac-2fd0-47cd-9367-36726603b249 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030714 Jul 21 20:52:27.257196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 3/3] 10.222.0.60 () {60 vars in 1155 bytes} [Thu Jul 21 20:52:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 20:52:27.271465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2276aaa5-5b87-4819-bba5-3e3ef4407937 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Calling method '.version_select at 0x7f3542087ca0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:28.137696 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-2276aaa5-5b87-4819-bba5-3e3ef4407937 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] HTTP exception thrown: Volume tempest-invalid-1985442957 could not be found. Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2276aaa5-5b87-4819-bba5-3e3ef4407937 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Request method failure captured: Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1985442957 HTTP/1.1 Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byJ41TdQS787qWH7UvDKQsFf7XomT8RYpEoOCjLI_Jn4eaHpsxFzXUweMiKlIlyD3d1E_nhxaumNxGowKFGq2Az7io_Dg7a4gkclLVST94m5b4lHIDHWBbkThrdZP9kAGg4xzzewPUcZqJbyGq7eWFuEZVLqIt8C0HxWF6dzCbZw8A Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:52:28.145127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab080027ba304297bd7a63d546b2bd61 Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Volume tempest-invalid-1985442957 could not be found. Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'tempest-invalid-1985442957'} Jul 21 20:52:28.146598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1985442957 could not be found. (HTTP 404) (Request-ID: req-cc6c3dde-4a1d-47a9-90ba-28a07ce142f5) Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.147353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:52:28.148871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1985442957 could not be found. Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:52:28.150879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1985442957 could not be found. Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1985442957 could not be found. Jul 21 20:52:28.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.166673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2276aaa5-5b87-4819-bba5-3e3ef4407937 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Returning 404 to user: Volume tempest-invalid-1985442957 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:52:28.169839 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2276aaa5-5b87-4819-bba5-3e3ef4407937 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1985442957" status: 404 len: 99 microversion: 2.1 time: 0.904077 Jul 21 20:52:28.177682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 4/4] 10.222.0.60 () {58 vars in 1217 bytes} [Thu Jul 21 20:52:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1985442957 => generated 99 bytes in 912 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 20:52:28.186224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-633df5c3-12da-4c2f-a351-dc0ff7cceaf7 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006294 Jul 21 20:52:28.195647 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 5/5] 10.222.0.60 () {58 vars in 1139 bytes} [Thu Jul 21 20:52:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 20:52:28.207920 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3558488f-fd31-4c18-a184-b5fe0e3a43ef tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010134 Jul 21 20:52:28.208865 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 6/6] 10.222.0.60 () {58 vars in 1136 bytes} [Thu Jul 21 20:52:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 20:52:28.251041 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-48d33931-7484-4a4b-a854-9d0355f0aada tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Calling method '.version_select at 0x7f3541fa2f70>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:28.317109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-09a3e6bf-1e20-4d2b-9d25-651aa0abcc16 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.814581 Jul 21 20:52:28.318699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 1/7] 10.222.0.60 () {60 vars in 1155 bytes} [Thu Jul 21 20:52:24 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3818 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 20:52:28.335104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7468c8d7-0d74-420f-b7aa-ffbacbb1ca98 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Calling method '.version_select at 0x7f3542022af0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:28.435213 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-48d33931-7484-4a4b-a854-9d0355f0aada tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] HTTP exception thrown: Volume f995d426-4b7a-4fb9-9c9d-5c924124fb37 could not be found. Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-48d33931-7484-4a4b-a854-9d0355f0aada tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Request method failure captured: Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/os-volumes/f995d426-4b7a-4fb9-9c9d-5c924124fb37 HTTP/1.1 Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byJ41TdQS787qWH7UvDKQsFf7XomT8RYpEoOCjLI_Jn4eaHpsxFzXUweMiKlIlyD3d1E_nhxaumNxGowKFGq2Az7io_Dg7a4gkclLVST94m5b4lHIDHWBbkThrdZP9kAGg4xzzewPUcZqJbyGq7eWFuEZVLqIt8C0HxWF6dzCbZw8A Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:52:28.441783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab080027ba304297bd7a63d546b2bd61 Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Volume f995d426-4b7a-4fb9-9c9d-5c924124fb37 could not be found. Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'f995d426-4b7a-4fb9-9c9d-5c924124fb37'} Jul 21 20:52:28.443356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f995d426-4b7a-4fb9-9c9d-5c924124fb37 could not be found. (HTTP 404) (Request-ID: req-d4f1c8c5-02c8-484b-89c9-37faf0550eaa) Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.444408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 20:52:28.445765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f995d426-4b7a-4fb9-9c9d-5c924124fb37 could not be found. Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 20:52:28.447087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f995d426-4b7a-4fb9-9c9d-5c924124fb37 could not be found. Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f995d426-4b7a-4fb9-9c9d-5c924124fb37 could not be found. Jul 21 20:52:28.449047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.453026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-48d33931-7484-4a4b-a854-9d0355f0aada tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Returning 404 to user: Volume f995d426-4b7a-4fb9-9c9d-5c924124fb37 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:52:28.453026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-48d33931-7484-4a4b-a854-9d0355f0aada tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/f995d426-4b7a-4fb9-9c9d-5c924124fb37" status: 404 len: 109 microversion: 2.1 time: 0.237854 Jul 21 20:52:28.453026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 7/8] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 20:52:28 2022] DELETE /compute/v2.1/os-volumes/f995d426-4b7a-4fb9-9c9d-5c924124fb37 => generated 109 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:52:28.468684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-276e5023-97cd-4fa7-9896-926d791ca035 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Calling method '.version_select at 0x7f3541fbd310>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:28.497182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7468c8d7-0d74-420f-b7aa-ffbacbb1ca98 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4" status: 200 len: 353 microversion: 2.1 time: 0.168364 Jul 21 20:52:28.497810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 2/9] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 20:52:28 2022] GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:52:28.592665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-276e5023-97cd-4fa7-9896-926d791ca035 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] HTTP exception thrown: Volume fb9f1b7d-f4c5-4291-bd6b-ea0283e180af could not be found. Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-276e5023-97cd-4fa7-9896-926d791ca035 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Request method failure captured: Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/os-volumes/fb9f1b7d-f4c5-4291-bd6b-ea0283e180af HTTP/1.1 Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byJ41TdQS787qWH7UvDKQsFf7XomT8RYpEoOCjLI_Jn4eaHpsxFzXUweMiKlIlyD3d1E_nhxaumNxGowKFGq2Az7io_Dg7a4gkclLVST94m5b4lHIDHWBbkThrdZP9kAGg4xzzewPUcZqJbyGq7eWFuEZVLqIt8C0HxWF6dzCbZw8A Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:52:28.596766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cda29a2ffb81483286571baa4f16d2e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: cda29a2ffb81483286571baa4f16d2e4 Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesNegativeTest-1602558111 Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab080027ba304297bd7a63d546b2bd61 Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesNegativeTest-1602558111-project Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Volume fb9f1b7d-f4c5-4291-bd6b-ea0283e180af could not be found. Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'fb9f1b7d-f4c5-4291-bd6b-ea0283e180af'} Jul 21 20:52:28.599193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb9f1b7d-f4c5-4291-bd6b-ea0283e180af could not be found. (HTTP 404) (Request-ID: req-a29a0b7c-77fd-4763-9cc8-0141d6c7a64c) Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.600700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:52:28.601997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb9f1b7d-f4c5-4291-bd6b-ea0283e180af could not be found. Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 20:52:28.603054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb9f1b7d-f4c5-4291-bd6b-ea0283e180af could not be found. Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb9f1b7d-f4c5-4291-bd6b-ea0283e180af could not be found. Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-276e5023-97cd-4fa7-9896-926d791ca035 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] Returning 404 to user: Volume fb9f1b7d-f4c5-4291-bd6b-ea0283e180af could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-276e5023-97cd-4fa7-9896-926d791ca035 tempest-VolumesNegativeTest-1602558111 tempest-VolumesNegativeTest-1602558111-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/fb9f1b7d-f4c5-4291-bd6b-ea0283e180af" status: 404 len: 109 microversion: 2.1 time: 0.139683 Jul 21 20:52:28.677956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 8/10] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 20:52:28 2022] GET /compute/v2.1/os-volumes/fb9f1b7d-f4c5-4291-bd6b-ea0283e180af => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:52:29.513788 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e4469d69-6558-4c6d-8f7e-1726817cfd1c tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Calling method '.version_select at 0x7f3542022ca0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:29.720872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e4469d69-6558-4c6d-8f7e-1726817cfd1c tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4" status: 200 len: 353 microversion: 2.1 time: 0.211345 Jul 21 20:52:29.721476 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 3/11] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 20:52:29 2022] GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:52:30.734980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6a390407-6e66-4ae6-a53e-8dbfa0dc2053 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Calling method '.version_select at 0x7f3541fa29d0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:30.831093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6a390407-6e66-4ae6-a53e-8dbfa0dc2053 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4" status: 200 len: 354 microversion: 2.1 time: 0.100627 Jul 21 20:52:30.831668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 9/12] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 20:52:30 2022] GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:52:30.844352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a3e54def-7630-456c-a1bc-48581b198287 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Calling method '.version_select at 0x7f3542038280>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:30.969705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a3e54def-7630-456c-a1bc-48581b198287 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4" status: 200 len: 354 microversion: 2.1 time: 0.130354 Jul 21 20:52:30.973263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 4/13] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 20:52:30 2022] GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:52:30.986756 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f2afce52-4263-49c4-bc86-1a9801badd6f tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Calling method '.version_select at 0x7f3541fbd0d0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:31.202197 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f2afce52-4263-49c4-bc86-1a9801badd6f tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4" status: 202 len: 0 microversion: 2.1 time: 0.218635 Jul 21 20:52:31.205959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 10/14] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 20:52:30 2022] DELETE /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:52:31.215823 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-954e13eb-5da5-444a-bf4b-de69cbd0a172 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Calling method '.version_select at 0x7f3542038940>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:31.317679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-954e13eb-5da5-444a-bf4b-de69cbd0a172 tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4" status: 200 len: 353 microversion: 2.1 time: 0.110727 Jul 21 20:52:31.318254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 5/15] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 20:52:31 2022] GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:52:32.331949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-30ce8efa-bc72-44eb-bdd1-4f829c151d9d tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Calling method '.version_select at 0x7f3541fc60d0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:32.409477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-30ce8efa-bc72-44eb-bdd1-4f829c151d9d tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] HTTP exception thrown: Volume b0b0103c-dbb0-4680-b420-f5a6371912d4 could not be found. Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-30ce8efa-bc72-44eb-bdd1-4f829c151d9d tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Request method failure captured: Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 HTTP/1.1 Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byIWn28IErppEwEjFAxtCEVpACevA4k88qVKEmoANz3H4HYpoYEoervrissketNbS-CdcGioflMd0cOeVOVz2Jot5BQTushY1qTk4HKjaTIRMN2jBTRe3MOzw2Nj7ARSEjHTPHT8lzNdFSiUdw-Fu69s-JVhi7guMwxAx7NHfsl1o4 Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 4b69684bfd6e47f2b6e5bb801b3140d8 Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesGetTestJSON-1196234327 Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:52:32.411977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4b69684bfd6e47f2b6e5bb801b3140d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4b69684bfd6e47f2b6e5bb801b3140d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4b69684bfd6e47f2b6e5bb801b3140d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4b69684bfd6e47f2b6e5bb801b3140d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesGetTestJSON-1196234327 Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 4b69684bfd6e47f2b6e5bb801b3140d8 Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesGetTestJSON-1196234327 Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesGetTestJSON-1196234327-project Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 82764d7145a24ccc841052a776d1e4a1 Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesGetTestJSON-1196234327-project Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Volume b0b0103c-dbb0-4680-b420-f5a6371912d4 could not be found. Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'b0b0103c-dbb0-4680-b420-f5a6371912d4'} Jul 21 20:52:32.413003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0b0103c-dbb0-4680-b420-f5a6371912d4 could not be found. (HTTP 404) (Request-ID: req-eaaf61a3-c32f-4c3c-b003-c3b2494e7674) Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:32.413590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 20:52:32.414416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0b0103c-dbb0-4680-b420-f5a6371912d4 could not be found. Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 20:52:32.419033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0b0103c-dbb0-4680-b420-f5a6371912d4 could not be found. Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0b0103c-dbb0-4680-b420-f5a6371912d4 could not be found. Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-30ce8efa-bc72-44eb-bdd1-4f829c151d9d tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] Returning 404 to user: Volume b0b0103c-dbb0-4680-b420-f5a6371912d4 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:52:32.419907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-30ce8efa-bc72-44eb-bdd1-4f829c151d9d tempest-VolumesGetTestJSON-1196234327 tempest-VolumesGetTestJSON-1196234327-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4" status: 404 len: 109 microversion: 2.1 time: 0.087217 Jul 21 20:52:32.421709 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 11/16] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 20:52:32 2022] GET /compute/v2.1/os-volumes/b0b0103c-dbb0-4680-b420-f5a6371912d4 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:52:37.881640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-864250474", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "networks": [{"uuid": "d80bf16f-8a10-4877-90cb-01785bb4b82c"}]}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:38.162582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] validate_networks() for [('d80bf16f-8a10-4877-90cb-01785bb4b82c', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:52:42.164299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:52:42.167635 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:52:42.168332 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:52:42.168919 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:52:42.169830 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:52:42.204616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:42.206010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:42.217208 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:42.220679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:42.303664 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Getting quotas for project 4fe52006c5034bbf8de92b8aae171d3c. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:52:42.313729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Getting quotas for user bc6b0bfbda8944369d1a83b52b400f64 and project 4fe52006c5034bbf8de92b8aae171d3c. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:52:42.368544 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:52:42.377717 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:52:42.571660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4b0fb4d6-c6de-4a92-a0dc-1fd1594e3fdc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.453903 Jul 21 20:52:42.578313 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 6/17] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 5459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:52:42.588419 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fdd5fef7-64c5-4a39-a994-8467657663e9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:42.590237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fdd5fef7-64c5-4a39-a994-8467657663e9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:43.164752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1419703900", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:43.259594 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] validate_networks() for [('12e272e6-6c0f-4346-988b-fccdfdf62793', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:52:43.326117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fdd5fef7-64c5-4a39-a994-8467657663e9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:43.385326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fdd5fef7-64c5-4a39-a994-8467657663e9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1214 microversion: 2.1 time: 0.791270 Jul 21 20:52:43.404979 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 12/18] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:42 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1214 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:44.292267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4f6f3695-a910-467f-88eb-60f7d7e4f3c5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'create', calling method: .version_select at 0x7f3541fc6940>, body: {"keypair": {"name": "tempest-keypair-1380704636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9SUBemd4xb5tiyHXPhkunrTx8h1lsZg1E6Jus9uf1EBYRy41PgrNShrryV44TaKFfAB9k38p3ksXN4kUQjBYKFbu0KOG3Occ3JMUyWSPsBzC0y+MLCN2jA5JXwHOXrpg=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:44.412456 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-4f6f3695-a910-467f-88eb-60f7d7e4f3c5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:52:44.441832 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-4f6f3695-a910-467f-88eb-60f7d7e4f3c5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for user 3a0d900f08d54098870ebbfa281e2a65 and project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:52:44.558235 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4f6f3695-a910-467f-88eb-60f7d7e4f3c5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.644487 Jul 21 20:52:44.558875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 13/19] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Jul 21 20:52:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 649 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 20:52:44.577224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f6f0a9bf-ee67-48cb-b817-4a19b5e7eb9c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:44.592494 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f6f0a9bf-ee67-48cb-b817-4a19b5e7eb9c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:44.653355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:52:44.653951 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:52:44.654386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:52:44.654873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:52:44.655366 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:52:44.691059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:44.691588 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:44.692474 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:44.692910 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:44.784924 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for project d9e9d8f8b55c4ef586252456ea195266. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:52:44.801614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f6f0a9bf-ee67-48cb-b817-4a19b5e7eb9c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:44.808234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for user 24e4efb87cd34008a1b83c0ea0cce5aa and project d9e9d8f8b55c4ef586252456ea195266. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:52:44.817917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f6f0a9bf-ee67-48cb-b817-4a19b5e7eb9c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1214 microversion: 2.1 time: 0.250242 Jul 21 20:52:44.821111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 14/20] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:44 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1214 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:44.869198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:52:44.877325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:52:45.001960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6c4cfc5e-95aa-46cd-a2ad-e785210ed55f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.240353 Jul 21 20:52:45.002499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 7/21] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:52:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 20:52:45.015902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ac3824b6-86e6-4f7c-a1a0-a6925cb3fefb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:45.016635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ac3824b6-86e6-4f7c-a1a0-a6925cb3fefb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:45.168276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ac3824b6-86e6-4f7c-a1a0-a6925cb3fefb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:45.189473 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ac3824b6-86e6-4f7c-a1a0-a6925cb3fefb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1222 microversion: 2.1 time: 0.180343 Jul 21 20:52:45.190811 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 15/22] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:45 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:45.503266 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1623682386", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:45.627086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] validate_networks() for [('12e272e6-6c0f-4346-988b-fccdfdf62793', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:52:45.839382 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:45.840143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:45.847818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:45.856688 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:45.857867 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:45.860676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:46.188677 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:46.210309 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cf27736d-4d6a-45c3-b527-1dd7af9b6f06 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1218 microversion: 2.1 time: 0.377793 Jul 21 20:52:46.220541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 16/23] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:45 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:52:47.227971 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:47.230305 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:47.249975 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:47.250778 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:47.253356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:47.256261 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:47.373776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:52:47.379312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:52:47.379932 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:52:47.380366 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:52:47.380799 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:52:47.424683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:47.425147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:47.425960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:47.426402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:47.484006 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:47.498327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-76a37838-116a-4c64-a0cb-1e6cd3b8f2df tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1218 microversion: 2.1 time: 0.274223 Jul 21 20:52:47.498916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 17/24] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:47 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1218 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:52:47.519144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for project d9e9d8f8b55c4ef586252456ea195266. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:52:47.531341 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for user 24e4efb87cd34008a1b83c0ea0cce5aa and project d9e9d8f8b55c4ef586252456ea195266. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:52:47.565196 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:52:47.569699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:52:47.666646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-de8a91e7-ecd2-44a8-8deb-d61d81fcb98c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.170571 Jul 21 20:52:47.673626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 8/25] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:52:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 20:52:47.688004 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f2c734b7-4ec0-405c-aec8-d327e4cccff2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:47.689168 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f2c734b7-4ec0-405c-aec8-d327e4cccff2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:47.932989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f2c734b7-4ec0-405c-aec8-d327e4cccff2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:47.945468 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f2c734b7-4ec0-405c-aec8-d327e4cccff2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1222 microversion: 2.1 time: 0.264353 Jul 21 20:52:47.948877 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 18/26] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:47 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1222 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:48.516321 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:48.517128 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:48.556753 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:48.557218 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:48.558010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:48.558453 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:48.966744 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:48.967829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:48.985744 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:48.989089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:48.995481 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:48.998948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:49.352891 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:49.428520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0568fd22-42bd-4057-b9f5-cc211fbddc6c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1274 microversion: 2.1 time: 0.916160 Jul 21 20:52:49.439785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 9/27] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:48 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1274 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:49.530018 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:49.545623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-24469d19-331f-40d2-ae56-b442c70b5198 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1226 microversion: 2.1 time: 0.583922 Jul 21 20:52:49.546226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 19/28] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:48 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1226 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:49.640394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-483595984", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b37db4ce-f6bd-42a4-9277-6fc954d54178"}], "security_groups": [{"name": "tempest-securitygroup--410481038"}], "key_name": "tempest-keypair-1380704636", "user_data": "}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:52:49.940999 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] validate_networks() for [('b37db4ce-f6bd-42a4-9277-6fc954d54178', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:52:50.458188 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:50.459980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:50.495565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:50.496482 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:50.497526 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:50.498174 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:50.756704 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:50.780536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0b1c1ca9-6803-47cf-8bd7-a0b89b0f7704 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1272 microversion: 2.1 time: 0.337193 Jul 21 20:52:50.781179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 20/29] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:50 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:52:50.808130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:50.808848 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:50.833929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:50.834161 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:50.855661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:50.861531 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:51.265968 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:51.273740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-011fec61-d17c-42c1-b551-0de54010b1cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1282 microversion: 2.1 time: 0.491483 Jul 21 20:52:51.274338 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 21/30] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:50 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1282 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:51.797662 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:51.798325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:51.805926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:51.806446 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:51.807233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:51.807671 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:52.033726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:52.045496 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6156a83e-99c5-49c8-b481-073dc54472a9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1272 microversion: 2.1 time: 0.251502 Jul 21 20:52:52.046289 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 22/31] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:51 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:52:52.292151 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:52.293097 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:52.301524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:52.304930 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:52.311850 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:52.312308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:52.723843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:52.742445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9ac24ca1-1c43-4cd1-857b-32ac7ba3fe5e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.450093 Jul 21 20:52:52.751518 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 23/32] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:52 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:52:53.065680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:53.066700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:53.074216 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:53.074901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:53.075886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:53.076465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:53.248431 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:52:53.249182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:52:53.249300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:52:53.250495 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:52:53.250495 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:52:53.269336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:53.269917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:53.270744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:53.271180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:53.329782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:52:53.346246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for user 3a0d900f08d54098870ebbfa281e2a65 and project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:52:53.379097 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:52:53.382507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:52:53.475076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a02b1d8b-26ed-4fc9-bc57-62ab56f93419 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.842889 Jul 21 20:52:53.476583 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 10/33] 10.222.0.60 () {62 vars in 1187 bytes} [Thu Jul 21 20:52:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 3845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 20:52:53.488671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5f2362ec-0c6b-41c3-8ddd-640c95a3182a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:53.490169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5f2362ec-0c6b-41c3-8ddd-640c95a3182a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:53.787312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:53.800212 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-92c81652-8ef1-434c-9094-49329c1cf2c3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.738681 Jul 21 20:52:53.829308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 24/34] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:53 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:53.846156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5f2362ec-0c6b-41c3-8ddd-640c95a3182a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:53.859461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:53.860559 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:53.883685 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:53.884574 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:53.886100 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:53.886856 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:53.896421 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5f2362ec-0c6b-41c3-8ddd-640c95a3182a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:53.899210 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5f2362ec-0c6b-41c3-8ddd-640c95a3182a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:53.914024 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5f2362ec-0c6b-41c3-8ddd-640c95a3182a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1281 microversion: 2.20 time: 0.429699 Jul 21 20:52:53.915313 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 11/35] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:52:53 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1281 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:52:54.074498 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:54.082150 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-09eb6b13-bb21-456d-92b8-776638e1b71a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.251393 Jul 21 20:52:54.091626 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 25/36] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:53 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:54.833118 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:54.833730 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:54.840551 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:54.840998 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:54.841771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:54.842398 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:54.938927 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:54.940585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:54.947400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:54.948146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:54.948909 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:54.949380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:55.026324 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:55.035246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9c0ce5a6-d697-4060-bc98-033ccde33672 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.205907 Jul 21 20:52:55.036429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 12/37] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:54 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:55.053432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:55.071676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:55.074854 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:55.076806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-89960897-b1d0-4cd7-85da-13b9f9474c0f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.144114 Jul 21 20:52:55.078674 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 26/38] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:52:54 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:52:55.109221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:55.110192 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:55.119570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:55.120399 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:55.121433 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:55.122019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:55.215214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:55.224323 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-15cab6f6-cfc8-46bf-a4b5-f61a8e0dea97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.129328 Jul 21 20:52:55.225089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 13/39] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:55 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:56.067831 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:56.069365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:56.076966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:56.078162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:56.079138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:56.079751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:56.097176 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:56.097871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:56.110695 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:56.111375 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:56.112252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:56.112726 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:56.207448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:56.218255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:56.220680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:56.222055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f71903fe-58d4-410e-b9d3-f3e09b228095 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.128679 Jul 21 20:52:56.232532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 14/40] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:52:56 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:52:56.243337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:56.244342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:56.271380 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:56.272820 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:56.275969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:56.276804 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:56.358652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:56.373091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-38e33342-bfa0-40d3-b78e-715780a12b81 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.322094 Jul 21 20:52:56.375287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 27/41] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:56 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:56.416490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:56.427641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2ed7df3f-8dba-44c7-adc3-0a5e94de0d8c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.189494 Jul 21 20:52:56.428709 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 15/42] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:56 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:57.244588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:57.245797 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:57.251999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:57.252447 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:57.253220 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:57.253707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:57.334774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:57.343692 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:57.345270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:57.346447 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c87e16b0-ff3e-4c62-98fa-ca60eb77a18d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.108166 Jul 21 20:52:57.347019 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 28/43] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:52:57 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:52:57.399962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:57.402150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:57.414239 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:57.415236 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:57.418865 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:57.420029 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:57.452250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:57.453287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:57.477607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:57.478399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:57.483363 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:57.488482 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:57.647050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:57.658048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f62a608b-22fb-44ec-823e-4a1451502c76 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.215620 Jul 21 20:52:57.658723 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 29/44] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:57 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:52:57.717801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:57.731580 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a686b626-0949-44be-ae0e-3dedc2d72185 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.340703 Jul 21 20:52:57.742078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 16/45] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:57 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:58.368614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:58.371588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:58.376353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=12 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:52:58.384560 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:58.385242 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:58.386076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:58.386574 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:58.493670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:58.505718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:58.507557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:58.510354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8688d7e3-903b-4f38-aa99-e25901af4684 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.148005 Jul 21 20:52:58.521022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 30/46] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:52:58 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:52:58.677359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:58.679101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:58.693667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:58.694176 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:58.695600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:58.696075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:58.749073 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:58.749700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:58.762296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:58.763280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:58.764159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:58.766141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:58.801869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:58.815438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2766c734-d4f5-4259-8afd-be157f8e0f31 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.143301 Jul 21 20:52:58.826065 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 17/47] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:58 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:58.989017 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:58.997652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e7a5bc95-a5d8-4b09-bc73-42f39255696f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.252664 Jul 21 20:52:58.998851 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 31/48] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:58 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:52:59.533363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:59.535155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:59.544856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:59.545645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:59.546685 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:59.547837 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:59.676368 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:59.689406 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:59.695320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:59.697909 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4f203890-a526-4e5e-873f-01e7fd6c6a9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.168830 Jul 21 20:52:59.710966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 18/49] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:52:59 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:52:59.834780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:52:59.835855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:52:59.844636 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:59.845185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:59.847057 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:52:59.847754 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:52:59.941330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:52:59.950855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-432f7dc4-44e4-45eb-980a-11ac65daa5bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.121057 Jul 21 20:52:59.951605 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 32/50] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:52:59 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:00.015500 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:00.016167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:00.023303 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:00.023793 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:00.024706 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:00.025725 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:00.227440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:00.241850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d625d1aa-69b9-4d13-a3f6-3fc4d3ccf0b8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.230413 Jul 21 20:53:00.244773 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 19/51] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:00 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:00.718768 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:00.719374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:00.726742 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:00.727185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:00.728042 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:00.728763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:00.750049 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:00.802422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:00.812190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:00.813985 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:00.815098 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b4a9b12c-add9-4ce0-a55d-ad06299a1737 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.101035 Jul 21 20:53:00.815807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 33/52] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:00 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:53:00.969505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:00.970388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:00.976744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:00.977201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:00.979215 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:00.979908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:01.052170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:01.061236 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ea521ebb-ac0a-47e8-91b3-71ab41217389 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.096302 Jul 21 20:53:01.062386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 20/53] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:00 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:01.264604 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:01.265456 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:01.272348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:01.272348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:01.273002 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:01.273439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:01.476051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:01.476270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-18c627ed-b51d-4891-9c17-863c34712ed8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.219065 Jul 21 20:53:01.479357 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 34/54] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:01 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:01.834977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:01.835995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:01.843730 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:01.844580 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:01.845948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:01.846713 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:01.934831 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:01.944985 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:01.953738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:01.954905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d60b751f-9fb8-4bcb-a776-de9c7e1a5ae4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.125329 Jul 21 20:53:01.955484 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 21/55] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:01 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:02.093132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:02.102449 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:02.120256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:02.122610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:02.125765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:02.127238 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:02.254816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:02.265499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8d11f225-cbee-4091-ae73-b45592984f79 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.179861 Jul 21 20:53:02.266083 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 35/56] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:02 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:02.497757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:02.498739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:02.507513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:02.508378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:02.510361 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:02.510980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:02.680741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:02.690017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-732c6443-6ee4-4a1c-938c-7f8686fd8622 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.197943 Jul 21 20:53:02.690604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 22/57] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:02 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:02.974027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:02.974650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:02.982942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:02.983390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:02.984193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:02.984621 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:03.067170 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:03.077254 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:03.078849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:03.080023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bd0eed88-bab0-4b36-a3f1-3d375002bfab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.109836 Jul 21 20:53:03.080578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 36/58] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:02 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:03.283647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:03.284385 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:03.291591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:03.292076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:03.293022 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:03.293688 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:03.310177 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=8 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:03.359202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:03.369046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-921f8e12-5255-4234-bccb-6ace72928d9c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.089128 Jul 21 20:53:03.369633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 23/59] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:03 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:03.707656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:03.708294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:03.717999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:03.718495 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:03.719229 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:03.719660 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:03.905967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:03.913489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6c6e1540-c90b-4c9c-9e00-7c53240e2c23 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.209649 Jul 21 20:53:03.914051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 37/60] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:03 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:04.098458 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:04.099230 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:04.101124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=26 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:04.107829 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:04.108329 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:04.109136 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:04.109745 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:04.180425 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:04.188702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:04.190301 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:04.191419 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-90f16de0-a16d-4b59-8191-48027da37936 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.096850 Jul 21 20:53:04.192015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 24/61] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:04 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:04.386919 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:04.387532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:04.394146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:04.394593 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:04.395551 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:04.396062 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:04.489838 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:04.506159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dcecfec2-a19b-407a-9585-c577f50263e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.123955 Jul 21 20:53:04.507033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 38/62] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:04 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:04.930397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:04.931745 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:04.934734 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:04.938320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:04.938765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:04.939568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:04.940183 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:05.069929 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:05.077447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8f96559a-9854-4fc9-b24d-98fcfe4777e2 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.150797 Jul 21 20:53:05.078027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 25/63] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:04 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:05.210293 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:05.210823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:05.218418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:05.219071 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:05.219977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:05.220531 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:05.289172 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:05.300539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:05.302215 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:05.303489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7efb6d9c-aef8-41b6-be87-c85bf44239c1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.097209 Jul 21 20:53:05.304255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 39/64] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:05 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:05.523103 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:05.523729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:05.531012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:05.531465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:05.532275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:05.532708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:05.536969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:05.611774 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:05.619461 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f061dea5-35ee-4907-b69e-239484395dc2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.100129 Jul 21 20:53:05.628030 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 26/65] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:05 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:06.106509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:06.107218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:06.114069 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:06.114611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:06.115825 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:06.116328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:06.266626 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:06.274299 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-721595ab-3806-4aaf-857f-ab1ed1aed2dd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.172893 Jul 21 20:53:06.276067 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 40/66] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:06 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:06.325478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:06.326305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:06.333440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:06.333893 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:06.334852 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:06.335665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:06.412472 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:06.428639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:06.430613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:06.432586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b4db934b-e12c-4261-ae8c-523bdb3306ad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.113959 Jul 21 20:53:06.433613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 27/67] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:06 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:06.640064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:06.640891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:06.652202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:06.652900 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:06.653854 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:06.654498 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:06.767139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:06.779896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6e555c6e-08a6-4203-86e1-e153a97ffa7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.146523 Jul 21 20:53:06.780743 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 41/68] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:06 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:07.294593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:07.295274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:07.304288 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:07.304741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:07.305539 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:07.306199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:07.452250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:07.452842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:07.463387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:07.464257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:07.466275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:07.470856 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:07.492985 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:07.505214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-eeca7da3-1130-41a6-8031-bf557782cc0f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.214844 Jul 21 20:53:07.505648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 28/69] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:07 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:07.559943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:07.569512 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:07.571015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:07.573023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6733161a-d343-46d1-ad7d-32655eb01efa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.124755 Jul 21 20:53:07.573940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 42/70] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:07 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:53:07.798354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:07.798974 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:07.808609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:07.809076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:07.809874 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:07.810488 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:07.885289 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:07.899912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ba0d215f-1b9e-46fc-b2b9-bc5ea267467b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.105759 Jul 21 20:53:07.900935 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 29/71] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:07 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:08.527885 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:08.529339 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:08.537279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:08.537839 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:08.538828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:08.539491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:08.596302 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:08.597471 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:08.604409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:08.605288 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:08.606430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:08.607645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:08.708809 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:08.717866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:08.719913 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:08.721257 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c040018a-72bb-401e-96e5-690a1ff976f1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.128953 Jul 21 20:53:08.734127 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 30/72] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:08 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:08.809877 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:08.819657 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c3d11ae6-da59-4f13-ae01-ffff97336f92 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.300020 Jul 21 20:53:08.829589 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 43/73] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:08 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:08.916068 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:08.917255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:08.925480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:08.926175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:08.927269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:08.928271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:09.018201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:09.029245 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-64374a91-da1d-4bc5-b273-a8581242d2ee tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.116912 Jul 21 20:53:09.035967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 31/74] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:08 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:09.741125 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:09.742344 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:09.752479 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:09.753328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:09.754190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:09.754696 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:09.843019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:09.844116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:09.844973 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:09.851642 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:09.852503 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:09.853539 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:09.854235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:09.857262 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:09.860166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:09.865071 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3d0e88cf-e575-4819-ba13-af981ad67df6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.127986 Jul 21 20:53:09.866049 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 44/75] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:09 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:10.034096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:10.043600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-493f4eea-7da8-4904-8ebf-191c1f654cc0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.210411 Jul 21 20:53:10.044220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 32/76] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:09 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:10.047896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:10.048913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:10.072783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:10.074130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:10.075201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:10.076455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:10.162297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:10.184156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-de795c83-f8ed-4345-a4f7-9e88b2d0f30a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.140671 Jul 21 20:53:10.184762 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 45/77] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:10 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:10.885790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:10.886395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:10.892514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:10.892962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:10.893728 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:10.894168 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:10.969230 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:10.978144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:10.980109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:10.981220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-15db66bc-7a23-4e2d-b201-83414ad58264 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.100564 Jul 21 20:53:10.981781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 33/78] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:10 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:11.061143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:11.061757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:11.068398 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:11.069093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:11.069941 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:11.070440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:11.202479 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:11.203096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:11.209927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:11.210367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:11.211326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:11.211775 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:11.251052 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:11.260524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c3c3cb15-592d-4bea-94ca-041f76cca155 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.203102 Jul 21 20:53:11.261673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 46/79] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:11 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:11.284584 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:11.292693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fa86965f-8d47-4f24-9985-b5315fc3aadc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.094037 Jul 21 20:53:11.293274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 34/80] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:11 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:12.000736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:12.001230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:12.007424 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:12.007902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:12.008773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:12.009212 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:12.071328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:12.079287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:12.080812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:12.082324 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f156642c-3a75-4100-bfda-a19010954059 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.085294 Jul 21 20:53:12.082444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 47/81] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:11 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:12.277692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:12.278201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:12.284654 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:12.285180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:12.286015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:12.286526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:12.315240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:12.315868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:12.324553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:12.325376 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:12.327961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:12.327961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:12.416803 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:12.425620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c75c6a29-41e4-4fd1-9189-477b4dae41f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.114114 Jul 21 20:53:12.434613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 48/82] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:12 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:12.449646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:12.457311 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-decd1a5c-8732-4f30-8a00-2a7bbc6eeb6b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.184208 Jul 21 20:53:12.457887 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 35/83] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:12 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:13.100541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:13.101141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:13.103368 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:13.108641 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:13.109078 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:13.109848 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:13.110275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:13.178026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:13.186749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:13.188284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:13.189393 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c126a9cc-234c-4d42-b94a-8d8c86b40c3b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.092785 Jul 21 20:53:13.189948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 49/84] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:13 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:13.445957 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:13.447130 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:13.455196 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:13.455650 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:13.456541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:13.456985 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:13.474374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:13.475004 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:13.482135 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:13.482616 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:13.483393 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:13.483860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:13.488446 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:13.520555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:13.528178 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-da199c72-2c18-4b2b-b50a-a5c156a74b21 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1280 microversion: 2.1 time: 0.089328 Jul 21 20:53:13.528956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 36/85] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:13 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:13.627683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:13.635667 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e4c35d4c-a3ab-4756-bf2d-20fe1324eab8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.164989 Jul 21 20:53:13.636593 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 50/86] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:13 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:14.210617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:14.211747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:14.219518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:14.220028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:14.220811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:14.221267 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:14.300679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:14.316167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:14.318256 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:14.319595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d2f9bdba-f4fd-4f19-b90c-30b573664c61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1285 microversion: 2.20 time: 0.115000 Jul 21 20:53:14.320751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 37/87] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:14 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:14.547866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:14.549215 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:14.557283 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:14.557928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:14.559076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:14.559664 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:14.653363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:14.660581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:14.671599 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:14.674112 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:14.675455 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:14.684218 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:14.886502 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:14.905491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-76746d5e-cd5f-4d69-8220-63ac26b68361 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.362880 Jul 21 20:53:14.906406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 51/88] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:14 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:15.085080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:15.095277 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-790872fa-b139-461b-a2f4-9e03b39425a0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.446152 Jul 21 20:53:15.096174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 38/89] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:14 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:15.342900 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:15.344556 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:15.356480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:15.357590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:15.359008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:15.359818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:15.660584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:15.682222 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:15.684095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:15.686295 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-796c02b3-af7f-435d-953e-36bb1a116ebe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1341 microversion: 2.20 time: 0.349743 Jul 21 20:53:15.687072 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 52/90] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:15 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1341 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:15.923981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:15.925206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:15.938788 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:15.939266 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:15.940858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:15.941314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:16.118976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:16.119944 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:16.140642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:16.141232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:16.142265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:16.142979 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:16.648173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:16.664306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c968396b-b095-4304-ba1c-18b224873e1c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.744233 Jul 21 20:53:16.664635 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 39/91] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:15 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:16.931232 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-7e953312-2c5b-41e3-be68-512b5bacb9a4 req-f9f1208a-62ed-4e94-911f-46dc6d18d8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ddeb6ba-597a-4d70-b8ce-8a803668cbdd", "tag": "7fbf5542-a0df-44eb-afda-0f932b4c5b95"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:53:16.955458 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-7e953312-2c5b-41e3-be68-512b5bacb9a4 req-f9f1208a-62ed-4e94-911f-46dc6d18d8b8 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:16.959393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-7e953312-2c5b-41e3-be68-512b5bacb9a4 req-f9f1208a-62ed-4e94-911f-46dc6d18d8b8 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.031336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-7e953312-2c5b-41e3-be68-512b5bacb9a4 req-f9f1208a-62ed-4e94-911f-46dc6d18d8b8 service nova] Creating event network-changed:7fbf5542-a0df-44eb-afda-0f932b4c5b95 for instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd on hv-cinder-85068 Jul 21 20:53:17.031811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-7e953312-2c5b-41e3-be68-512b5bacb9a4 req-f9f1208a-62ed-4e94-911f-46dc6d18d8b8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 20:53:17.032946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b520166-529c-4b61-8312-bfbf7d56b8c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:17.037718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b520166-529c-4b61-8312-bfbf7d56b8c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.046920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b520166-529c-4b61-8312-bfbf7d56b8c9 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:17.048223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b520166-529c-4b61-8312-bfbf7d56b8c9 None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.048625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:17.066803 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2b047fd7-39c4-4595-8ec1-4fb5c130d22c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.950538 Jul 21 20:53:17.079484 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 53/92] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:16 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:17.094267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:17.095056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:17.095201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.compute.rpcapi [None req-0b520166-529c-4b61-8312-bfbf7d56b8c9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 20:53:17.096227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b520166-529c-4b61-8312-bfbf7d56b8c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 20:53:17.121029 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:17.124189 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.125430 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:17.125985 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.145052 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0b520166-529c-4b61-8312-bfbf7d56b8c9 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478070 Jul 21 20:53:17.146330 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 40/93] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:53:17.515584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:17.535325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:17.537008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:17.538157 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d541e507-efed-4296-99a6-b9b99fd74799 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1339 microversion: 2.20 time: 0.457475 Jul 21 20:53:17.538734 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 54/94] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:17 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1339 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:17.697811 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:17.698654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:17.737914 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:17.738643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.743548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:17.748455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.776263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-9ca21838-aeb0-41c5-8fe5-a341eb8d6922 req-9cc84be6-e5fb-41a1-8952-67aeae46808c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b881a042-84ac-4864-9004-f1f385293d9f", "tag": "a6fd06b5-db86-4220-918a-dca146cd3b1a"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:53:17.794491 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-9ca21838-aeb0-41c5-8fe5-a341eb8d6922 req-9cc84be6-e5fb-41a1-8952-67aeae46808c service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:17.794971 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-9ca21838-aeb0-41c5-8fe5-a341eb8d6922 req-9cc84be6-e5fb-41a1-8952-67aeae46808c service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:17.824094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-9ca21838-aeb0-41c5-8fe5-a341eb8d6922 req-9cc84be6-e5fb-41a1-8952-67aeae46808c service nova] Creating event network-changed:a6fd06b5-db86-4220-918a-dca146cd3b1a for instance b881a042-84ac-4864-9004-f1f385293d9f on hv-cinder-85068 Jul 21 20:53:17.835468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-9ca21838-aeb0-41c5-8fe5-a341eb8d6922 req-9cc84be6-e5fb-41a1-8952-67aeae46808c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393458 Jul 21 20:53:17.839842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 41/95] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:53:18.090412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:18.090412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:18.104660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:18.105114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:18.105908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:18.106351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:18.249149 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:18.265855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d3333a5c-04c4-4272-9a1c-7d086443a21f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.574543 Jul 21 20:53:18.267148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 55/96] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:17 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:18.559081 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:18.560702 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:18.584336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:18.585374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:18.588376 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:18.589232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:18.774279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:18.791981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-92adcad5-d3fc-48d9-b43a-2b44a5206fdd tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.709918 Jul 21 20:53:18.793292 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 42/97] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:18 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:18.898199 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:18.910529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:18.912420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:18.913749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b5ce5615-2136-4ca7-9cae-10d55e076231 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.359637 Jul 21 20:53:18.914312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 56/98] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:18 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:53:19.283352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:19.283973 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:19.290842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:19.291500 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:19.292631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:19.292794 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:19.458395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:19.462227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:19.469746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b8c17818-1ce5-407b-8e26-d8a6129ccfa1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.190071 Jul 21 20:53:19.470569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 43/99] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:19 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:19.814763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:19.815620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:19.824384 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:19.824841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:19.825621 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:19.826095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:19.876207 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-f92e5c44-0fe2-4acc-9e97-f272152724a3 req-48a4e048-cbb7-4b22-a743-33572f2e647f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77154d49-ec36-4137-8c96-ceb20188d32e", "tag": "021cc3b8-5795-418d-85f7-7d0dcc124d4d"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:53:19.885656 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-f92e5c44-0fe2-4acc-9e97-f272152724a3 req-48a4e048-cbb7-4b22-a743-33572f2e647f service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:19.886147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-f92e5c44-0fe2-4acc-9e97-f272152724a3 req-48a4e048-cbb7-4b22-a743-33572f2e647f service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:19.908229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-f92e5c44-0fe2-4acc-9e97-f272152724a3 req-48a4e048-cbb7-4b22-a743-33572f2e647f service nova] Creating event network-changed:021cc3b8-5795-418d-85f7-7d0dcc124d4d for instance 77154d49-ec36-4137-8c96-ceb20188d32e on hv-cinder-85068 Jul 21 20:53:19.915543 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-f92e5c44-0fe2-4acc-9e97-f272152724a3 req-48a4e048-cbb7-4b22-a743-33572f2e647f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044583 Jul 21 20:53:19.919262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 44/100] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:53:19.937306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:19.937306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:19.943878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:19.945016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:19.945795 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:19.946565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:20.116920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:20.125784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:20.127310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:20.128478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bbb73772-46d9-4ae2-b06a-7a2ae2e6aa89 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.199889 Jul 21 20:53:20.129052 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 45/101] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:19 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:53:20.135334 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:20.143440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-038dadb7-e28f-4e24-b704-5625633832f9 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.333266 Jul 21 20:53:20.157794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 57/102] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:19 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:20.490448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:20.491842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:20.501758 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:20.502197 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:20.508249 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:20.509558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:20.675280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:20.685581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f4fdfa18-65a0-449e-8227-7abfe9e39d2d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.199385 Jul 21 20:53:20.686447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 46/103] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:20 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:21.149479 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:21.150249 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:21.161816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:21.162313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:21.163267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:21.163704 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:21.168673 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:21.169286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:21.175920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:21.176644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:21.177796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:21.178556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:21.329158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:21.338472 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:21.340348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:21.341846 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-38291a2c-2006-4d47-acce-b73c15dc6030 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.196634 Jul 21 20:53:21.342430 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 58/104] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:21 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:21.356122 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:21.364245 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bc0ee3c5-5cdb-4418-9fd3-1ce02dd103a8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.203002 Jul 21 20:53:21.365172 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 47/105] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:21 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:21.704008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:21.704622 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:21.710627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:21.711063 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:21.712862 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:21.713297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:21.870177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:21.878948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-01936347-0978-4e65-9f82-4d6a29c3bdfb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.179148 Jul 21 20:53:21.879671 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 59/106] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:21 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:22.367259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:22.368528 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:22.382488 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:22.383235 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:22.391586 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:22.392073 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:22.392865 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:22.393306 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:22.405127 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:22.405499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:22.406294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:22.406737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:22.661993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:22.676940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:22.679147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:22.681431 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3361f1d3-eb7d-436f-8e5e-6d976b0a07b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.319628 Jul 21 20:53:22.682369 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 48/107] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:22 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:22.704011 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:22.712064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-eeddfe9b-d029-46c4-92c9-9a63f818dfe7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.332849 Jul 21 20:53:22.712768 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 60/108] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:22 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:22.896053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:22.896633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:22.924303 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:22.928054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:22.929532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:22.936606 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.176603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:23.184365 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-34406191-e93a-44bd-9380-694cb8e698b9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.292002 Jul 21 20:53:23.184961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 49/109] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:22 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:23.221668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-75591886-e84a-4aea-a897-2831ece5530a req-210df65e-78eb-4d65-8e5a-8338674581ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b1f12b-2ec1-4e9b-ac1b-61385f597069", "tag": "0a15578f-a527-4939-9a6b-ce6d94093a88"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:53:23.236729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-75591886-e84a-4aea-a897-2831ece5530a req-210df65e-78eb-4d65-8e5a-8338674581ae service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:23.236729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-75591886-e84a-4aea-a897-2831ece5530a req-210df65e-78eb-4d65-8e5a-8338674581ae service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.259785 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-75591886-e84a-4aea-a897-2831ece5530a req-210df65e-78eb-4d65-8e5a-8338674581ae service nova] Creating event network-changed:0a15578f-a527-4939-9a6b-ce6d94093a88 for instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 on hv-cinder-85068 Jul 21 20:53:23.260325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-75591886-e84a-4aea-a897-2831ece5530a req-210df65e-78eb-4d65-8e5a-8338674581ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=124646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 20:53:23.261673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d58e9dba-3def-4151-b220-021efd48fcdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:23.262459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d58e9dba-3def-4151-b220-021efd48fcdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.263422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d58e9dba-3def-4151-b220-021efd48fcdf None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:23.264048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d58e9dba-3def-4151-b220-021efd48fcdf None None] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.273998 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.compute.rpcapi [None req-d58e9dba-3def-4151-b220-021efd48fcdf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 20:53:23.274926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d58e9dba-3def-4151-b220-021efd48fcdf None None] Releasing lock "compute-rpcapi-router" {{(pid=124646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 20:53:23.293568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d58e9dba-3def-4151-b220-021efd48fcdf None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075432 Jul 21 20:53:23.294201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 61/110] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:53:23.699929 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:23.700444 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:23.706827 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:23.707282 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.708113 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:23.708550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.736447 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:23.737624 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:23.748003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:23.748878 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.750295 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:23.751123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:23.861161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:23.874933 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:23.876523 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:23.877785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fa6a2d4f-d53c-4ad2-bfb3-52ae2bfe5e45 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.182069 Jul 21 20:53:23.878603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 50/111] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:23 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:23.898594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:23.907114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-416914ee-4723-425a-8950-d2aa0c523947 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.177859 Jul 21 20:53:23.907693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 62/112] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:23 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:24.202826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:24.202826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:24.208917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:24.209339 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:24.210110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:24.210641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:24.357205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:24.366350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ca9ced5b-1fc0-4a03-9c2b-fdcb23f5c3d3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.168656 Jul 21 20:53:24.366971 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 51/113] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:24 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:24.906516 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:24.907290 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:24.914527 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:24.915204 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:24.916060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:24.916543 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:24.924510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:24.925823 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:24.933331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:24.933781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:24.934550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:24.934990 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:25.053614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:25.066550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:25.068615 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:25.070328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d3881441-a8e3-48b7-a4b7-a11d6cb6e599 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.167757 Jul 21 20:53:25.071196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 63/114] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:24 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:25.088770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:25.101619 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3536f12e-7efc-4c7c-93d9-6e205ec43744 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.180938 Jul 21 20:53:25.102883 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 52/115] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:24 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:25.385606 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:25.386562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:25.392770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:25.393214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:25.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:25.394440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:25.564193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:25.573832 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-14247b52-a285-4bad-97a6-b69974c83409 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.192545 Jul 21 20:53:25.574474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 64/116] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:25 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:26.093501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:26.095222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:26.104633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:26.105340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:26.106269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:26.107028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:26.129145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:26.130325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:26.139307 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:26.141092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:26.142818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:26.143661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:26.331265 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:26.341143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:26.343027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:26.344283 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c38da52d-f863-464e-a678-882ec203c04f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.255994 Jul 21 20:53:26.345096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 53/117] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:26 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:26.358669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:26.367410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7ca1186d-3076-4079-9451-c8422bf078f0 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.244288 Jul 21 20:53:26.369412 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 65/118] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:26 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:26.591981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:26.592648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:26.602879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:26.603641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:26.604467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:26.605058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:26.778140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:26.791651 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-86f94f78-c69c-44ab-86de-5b3a0f67c0e1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.202328 Jul 21 20:53:26.792710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 54/119] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:26 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:27.370562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:27.371276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:27.387368 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:27.388017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:27.390381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:27.405254 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:27.406320 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:27.406613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:27.407052 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:27.413948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:27.415445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:27.416357 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:27.416800 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:27.596571 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:27.611740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:27.614168 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:27.616192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-607e5d0d-580f-438d-9c3b-2ede5c53016b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.257178 Jul 21 20:53:27.620530 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 66/120] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:27 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:27.812048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:27.823337 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:27.851062 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:27.854960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:27.858957 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:27.870090 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:27.875604 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:27.895939 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:27.908344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ae0a90f0-4a48-451e-ace0-5a1ffde4aa28 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.526091 Jul 21 20:53:27.909506 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 55/121] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:27 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:28.161737 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:28.172420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6904fb91-3c69-4588-8eb9-332c7fdca6da tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.365561 Jul 21 20:53:28.176830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 67/122] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:27 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:28.644922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:28.645635 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:28.655284 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:28.657662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:28.658499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:28.659105 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:28.927492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:28.928284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:28.943383 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:28.948161 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:28.949250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:28.949811 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:29.088221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:29.104601 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:29.109843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:29.113502 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b3efdca8-32ee-41de-ade4-bc853624ebbc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.472749 Jul 21 20:53:29.117212 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 56/123] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:28 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:29.189749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:29.190829 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:29.198670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:29.199417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:29.200270 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:29.201025 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:29.223101 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:29.232947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3d9f56e7-6fee-4947-9267-9b6904ffa6c7 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.309370 Jul 21 20:53:29.234873 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 68/124] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:28 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:29.376991 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:29.388671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e9a85a43-4c15-4b68-9489-f377cd179db8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.202793 Jul 21 20:53:29.400061 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 57/125] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:29 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:30.137993 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:30.139000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:30.153818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:30.154784 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:30.156850 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:30.157856 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:30.255078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:30.256856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:30.268177 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:30.269062 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:30.270017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:30.270707 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:30.324103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:30.332850 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:30.335024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:30.336976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ff6ec373-70e4-4254-9107-d847768fec7e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.206145 Jul 21 20:53:30.348948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 69/126] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:30 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:53:30.408544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:30.409353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:30.420311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:30.421003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:30.421931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:30.422823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:30.444802 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:30.453386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e27b3bdb-f526-40b7-8655-0b4c2396bab4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.204656 Jul 21 20:53:30.454748 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 58/127] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:30 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:30.608117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:30.620171 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6822bcf8-3755-4d4f-8929-48d9914c2f13 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.217143 Jul 21 20:53:30.620917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 70/128] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:30 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:31.356563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:31.357826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:31.369499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:31.370009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:31.370799 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:31.371243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:31.471524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:31.473893 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:31.491189 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:31.491899 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:31.493444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:31.494155 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:31.642855 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:31.652214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:31.653734 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:31.654868 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7559567c-d4a9-4652-83b8-63fd6cdb9c79 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.302520 Jul 21 20:53:31.656116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 59/129] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:31 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:53:31.660883 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:31.661664 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:31.672442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:31.673186 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:31.674222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:31.674811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:31.777519 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:31.787303 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-12201fa1-524c-4889-9f84-1dc97b959794 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.319357 Jul 21 20:53:31.788308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 71/130] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:31 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:31.858571 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:31.868362 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-aa91e028-95bb-4357-ba4a-7f5496bea849 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.210310 Jul 21 20:53:31.869259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 60/131] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:31 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:32.674864 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:32.675473 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:32.682940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:32.683738 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:32.685082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:32.685659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:32.807584 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:32.808268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:32.825329 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:32.825662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:32.826795 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:32.827417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:32.855884 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:32.909230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:32.917902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:32.919421 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:32.920575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-69ba29d7-77a0-4c04-8a02-c60589477222 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.250363 Jul 21 20:53:32.921146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 72/132] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:32 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:32.925845 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:32.926632 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:32.934695 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:32.935390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:32.936269 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:32.936900 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:33.012435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:33.022713 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-86ecb5fa-ce9a-4fd4-a2e9-154ad8ac9530 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.220038 Jul 21 20:53:33.031620 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 61/133] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:32 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:33.137561 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:33.152210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8694eb8c-050e-430e-ac4d-8e1980a99a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.229498 Jul 21 20:53:33.153060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 73/134] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:32 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:33.941340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:33.942336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:33.953353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:33.955205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:33.956201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:33.957553 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:34.040830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:34.042191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:34.049124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:34.056763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:34.057218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:34.058014 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:34.058444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:34.159734 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:34.170418 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:34.173532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:34.175410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4385fb89-f247-41f0-9db5-efd117a49e1e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.238782 Jul 21 20:53:34.176604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 62/135] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:33 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:34.182920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:34.183782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:34.193038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:34.193710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:34.194681 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:34.195426 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:34.338822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:34.349464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-63b8fa24-f476-4b5c-8d70-a680946bf41d tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.312704 Jul 21 20:53:34.350511 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 74/136] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:34 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:34.709455 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:34.731191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-42d47e6a-f267-454c-b4e4-b8e508a57101 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.552402 Jul 21 20:53:34.732398 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 63/137] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:34 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:34.776714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-9fcf5863-7e51-441b-b681-6db0bb2531ee req-63b805ca-be51-4163-a821-97b363636351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ddeb6ba-597a-4d70-b8ce-8a803668cbdd", "name": "network-vif-plugged", "status": "completed", "tag": "7fbf5542-a0df-44eb-afda-0f932b4c5b95"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:53:34.797016 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-9fcf5863-7e51-441b-b681-6db0bb2531ee req-63b805ca-be51-4163-a821-97b363636351 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:34.797653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-9fcf5863-7e51-441b-b681-6db0bb2531ee req-63b805ca-be51-4163-a821-97b363636351 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:34.819834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-9fcf5863-7e51-441b-b681-6db0bb2531ee req-63b805ca-be51-4163-a821-97b363636351 service nova] Creating event network-vif-plugged:7fbf5542-a0df-44eb-afda-0f932b4c5b95 for instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd on hv-cinder-85068 Jul 21 20:53:34.828601 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-9fcf5863-7e51-441b-b681-6db0bb2531ee req-63b805ca-be51-4163-a821-97b363636351 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476825 Jul 21 20:53:34.830663 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 75/138] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:53:35.206542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:35.207193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:35.210823 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=77 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:35.225166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:35.225792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:35.229202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:35.230698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:35.369947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:35.371697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:35.388470 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:35.390861 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:35.392774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:35.393397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:35.432949 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:35.446750 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:35.450966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:35.452151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-de3eb291-0832-4be3-9ecd-6272129832a4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.249891 Jul 21 20:53:35.452726 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 64/139] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:35 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:35.635667 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:35.653983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-10b49c15-1c2d-422c-ac0b-c068b7213b01 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.290525 Jul 21 20:53:35.668322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 76/140] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:35 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:35.750346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:35.751089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:35.765713 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:35.766521 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:35.767338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:35.767976 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:35.934959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:35.944348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f507f28d-d813-4010-84fa-8efe2a3d870c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.199363 Jul 21 20:53:35.945394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 65/141] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:35 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:36.470913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:36.471983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:36.480493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:36.481062 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:36.482164 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:36.482672 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:36.644107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:36.653025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:36.654544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:36.655626 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-29d5feab-6fe4-4ce9-87b0-0075542f03bc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.188751 Jul 21 20:53:36.656388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 77/142] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:36 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:36.679447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:36.681913 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:36.688841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:36.689365 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:36.693074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:36.693808 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:36.902467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:36.917451 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fa45052a-4945-40cf-8cad-d2dbb52724d6 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.241671 Jul 21 20:53:36.918151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 66/143] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:36 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:36.970327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:36.971420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:36.982951 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:36.983982 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:36.985258 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:36.985848 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:37.178032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:37.196705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2d36d789-79de-4b56-9c2c-c8221bbeac59 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.236909 Jul 21 20:53:37.200224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 78/144] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:36 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:37.682160 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:37.683355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:37.689715 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:37.690162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:37.690969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:37.691403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:37.851489 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:37.862129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:37.863754 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:37.864850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ffbba81e-b639-4523-bd6e-f92dcbf598d4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.187732 Jul 21 20:53:37.865412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 67/145] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:37 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:37.942552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:37.943120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:37.949362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:37.949802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:37.950598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:37.951035 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:38.094248 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:38.102750 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7cc37c9e-46d3-4d3f-9b5f-d2f2937ea0cf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.163358 Jul 21 20:53:38.103315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 79/146] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:37 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:38.217348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:38.217963 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:38.224463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:38.224917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:38.225694 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:38.226148 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:38.375447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:38.387332 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8dcbef9f-d25a-43f2-b9dd-5b430388fc71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.173562 Jul 21 20:53:38.388154 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 68/147] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:38 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:38.884464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:38.885107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:38.893077 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:38.893562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:38.894311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:38.894775 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:39.031291 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:39.040381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:39.041904 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:39.043017 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a64ec132-f2ad-4f28-8260-1b0f3af8c8db tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.163394 Jul 21 20:53:39.043613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 80/148] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:38 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:39.120633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:39.121168 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:39.127080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:39.127518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:39.128312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:39.128770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:39.266747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:39.275849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-61fd9de5-7f5d-4da3-8020-64700bd28094 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.159632 Jul 21 20:53:39.276436 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 69/149] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:39 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:39.404682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:39.405307 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:39.411484 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:39.411925 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:39.412702 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:39.413136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:39.558195 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:39.565851 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5082f79b-8682-4d94-9282-64ec1fa9d190 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.165758 Jul 21 20:53:39.566417 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 81/150] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:39 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:40.061744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:40.062349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:40.068458 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:40.068903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:40.069703 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:40.070144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:40.214738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:40.223205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:40.224736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:40.225841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-67321318-d13d-4bce-87be-1dab97950550 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.168084 Jul 21 20:53:40.226468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 70/151] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:40 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:40.292708 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:40.293322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:40.299644 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:40.300120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:40.300897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:40.301328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:40.440990 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:40.450572 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a5e99ecb-f4a6-4c54-a423-9d3d9e0553fc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.161451 Jul 21 20:53:40.451486 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 82/152] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:40 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:40.582549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:40.583258 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:40.590362 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:40.590889 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:40.591773 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:40.592427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:40.749633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:40.757642 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4e7477eb-a0ea-4e50-b845-3323de2d0e78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.179020 Jul 21 20:53:40.758312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 71/153] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:40 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:41.244537 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:41.245054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:41.251100 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:41.251538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:41.252322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:41.252750 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:41.401281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:41.411141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:41.412684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:41.413837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8f612cd5-a9cd-4140-bdde-3bb11f06de1a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.173272 Jul 21 20:53:41.415576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 83/154] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:41 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:41.468930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:41.469613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:41.476606 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:41.477178 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:41.478066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:41.478565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:41.662590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:41.671225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cd0a0883-10b1-4aa8-a3c5-d8c442c79126 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.206387 Jul 21 20:53:41.678477 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 72/155] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:41 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:41.774471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:41.775006 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:41.784306 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:41.785114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:41.785926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:41.786368 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:41.805425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:41.923363 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:41.931767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5ca5230c-b71b-414a-9e6e-44aae07de697 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.161535 Jul 21 20:53:41.932351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 84/156] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:41 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:42.433774 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:42.434383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:42.442824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:42.442824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:42.442824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:42.442824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:42.585203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:42.594054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:42.595542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:42.596699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-47b92bfc-8fe7-4f4e-9d00-f9e753b57697 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.167552 Jul 21 20:53:42.597264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 73/157] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:42 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:42.688462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:42.689211 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:42.696268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:42.696788 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:42.697643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:42.698140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:42.849245 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:42.858360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5b92ab31-3f6a-41da-9d15-fa8b977e667f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.173870 Jul 21 20:53:42.858943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 85/158] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:42 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:42.949387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:42.950069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:42.957204 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:42.957646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:42.958405 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:42.958832 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:43.104501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:43.112394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8f83a3fb-4054-40dd-85b0-253b4f6c548d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.167352 Jul 21 20:53:43.112971 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 74/159] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:42 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:43.615746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:43.616356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:43.618874 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=74 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:43.624294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:43.624744 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:43.625528 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:43.625964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:43.776225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:43.785122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:43.786664 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:43.787819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f4cd7992-fb5c-4920-8e84-1f563c3fc865 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.175948 Jul 21 20:53:43.790657 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 86/160] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:43 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:43.876797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:43.877396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:43.884210 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:43.884652 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:43.885412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:43.885840 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:44.021811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:44.030063 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5162dd9c-6695-452d-b692-1b63d412d565 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.157023 Jul 21 20:53:44.030663 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 75/161] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:43 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:44.129880 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:44.130547 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:44.137787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:44.138235 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:44.138997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:44.139448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:44.282792 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:44.290829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0e449461-7d5a-4401-ba69-5c91745c4489 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.164926 Jul 21 20:53:44.291405 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 87/162] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:44 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:44.808384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:44.809469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:44.817469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:44.817926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:44.818719 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:44.819158 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:44.994197 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:45.002708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:45.004246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:45.005367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e6390fe2-777d-4320-9eea-95a6c33f4ca4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.202549 Jul 21 20:53:45.005936 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 76/163] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:44 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:45.047286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:45.047917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:45.054163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:45.055148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:45.056163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:45.056600 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:45.208642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:45.217385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a0ff5c1f-e964-47d7-a58f-9e3e6c91e0c8 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.173624 Jul 21 20:53:45.217983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 88/164] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:45 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:45.308353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:45.308984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:45.315286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:45.315747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:45.316518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:45.316945 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:45.451157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:45.454573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:45.459512 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-df836a81-d766-4923-a660-297e465a5a93 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.155534 Jul 21 20:53:45.460062 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 77/165] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:45 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:46.025366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:46.025974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:46.032097 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:46.032565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:46.033315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:46.033746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:46.177691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:46.186339 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:46.187870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:46.188993 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-707aacb0-ae30-4261-9377-5abda6d89348 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.168418 Jul 21 20:53:46.189563 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 89/166] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:46 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:46.241505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:46.242344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:46.248995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:46.249442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:46.250214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:46.250651 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:46.396998 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:46.406348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e12e4a9e-fa4e-41f9-bb0c-89c4d739cd21 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.168598 Jul 21 20:53:46.406964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 78/167] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:46 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:46.476209 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:46.477190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:46.483850 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:46.484269 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:46.485040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:46.485472 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:46.644330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:46.656100 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4e25f877-e371-41fb-9b13-e56de7be8f70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.183703 Jul 21 20:53:46.656804 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 90/168] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:46 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:46.682560 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-0df8aa67-f4a4-4882-aaf0-ee981e75c6e4 req-f2c0086a-d06f-49f9-b8f7-9e28c9baa4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b881a042-84ac-4864-9004-f1f385293d9f", "name": "network-vif-plugged", "status": "completed", "tag": "a6fd06b5-db86-4220-918a-dca146cd3b1a"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:53:46.692187 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-0df8aa67-f4a4-4882-aaf0-ee981e75c6e4 req-f2c0086a-d06f-49f9-b8f7-9e28c9baa4f4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:46.692633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-0df8aa67-f4a4-4882-aaf0-ee981e75c6e4 req-f2c0086a-d06f-49f9-b8f7-9e28c9baa4f4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:46.707100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-0df8aa67-f4a4-4882-aaf0-ee981e75c6e4 req-f2c0086a-d06f-49f9-b8f7-9e28c9baa4f4 service nova] Creating event network-vif-plugged:a6fd06b5-db86-4220-918a-dca146cd3b1a for instance b881a042-84ac-4864-9004-f1f385293d9f on hv-cinder-85068 Jul 21 20:53:46.713628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-0df8aa67-f4a4-4882-aaf0-ee981e75c6e4 req-f2c0086a-d06f-49f9-b8f7-9e28c9baa4f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035690 Jul 21 20:53:46.714249 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 79/169] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:53:47.211447 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:47.212450 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:47.221592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:47.222248 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:47.223526 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:47.224221 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:47.413410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:47.428087 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:47.429414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:47.437309 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:47.438823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:47.440004 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a4984fbc-06e7-4a1f-9d17-d3979b2bfd0e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.234170 Jul 21 20:53:47.440581 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 91/170] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:47 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:47.447805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:47.448260 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:47.449045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:47.449669 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:47.627445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:47.636546 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3698db6b-e9eb-4734-904b-261cacecc551 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.214417 Jul 21 20:53:47.637297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 80/171] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:47 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:47.676898 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:47.682735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:47.686814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:47.687619 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:47.688703 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:47.689946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:48.460255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:48.462006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:48.474273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:48.476884 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:48.477919 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:48.481119 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:48.481995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:48.501608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5a442687-5937-4667-a3e3-cb5e0db2b7f7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.831114 Jul 21 20:53:48.504453 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 92/172] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:47 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:48.657362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:48.658125 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:48.667009 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:48.667428 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:48.673202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:48.673830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:49.181993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:49.198563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:49.201162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:49.204297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4205d132-f232-4164-9967-4b87d0da4e13 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.749229 Jul 21 20:53:49.234758 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 81/173] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:48 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:49.515972 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:49.524192 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:49.525190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:49.528436 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d71aef5e-2a83-4bbe-b978-31d9305f3ddc tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.876491 Jul 21 20:53:49.529948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 93/174] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:48 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:49.533648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:49.534106 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:49.534879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:49.535315 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:49.702720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:49.712045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-88cec374-e315-470f-99d7-9a44648afd40 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.192315 Jul 21 20:53:49.712865 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 82/175] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:49 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:50.228165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:50.228694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:50.235156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:50.235663 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:50.236771 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:50.237208 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:50.374276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:50.382907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:50.385982 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:50.387131 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0d15d89d-73fe-4890-bd1f-b3b748d3ce61 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.164031 Jul 21 20:53:50.387666 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 94/176] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:50 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:50.546091 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:50.546747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:50.552715 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:50.553154 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:50.553915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:50.554413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:50.698188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:50.706449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9acc1070-2de0-485b-a32c-7c7a64ac7f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.164118 Jul 21 20:53:50.707023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 83/177] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:50 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:50.728903 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:50.729527 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:50.735674 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:50.736412 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:50.737183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:50.737619 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:50.881603 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:50.889952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-afb89566-f6eb-4ab8-b213-a4dc5a01008d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.165039 Jul 21 20:53:50.890539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 95/178] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:50 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:51.411962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:51.412571 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:51.419770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:51.420223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:51.421159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:51.421660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:51.553759 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:51.562678 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:51.564316 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:51.565422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-da507416-2b60-457b-9cd6-a8fbe670b5fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.157620 Jul 21 20:53:51.565993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 84/179] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:51 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:51.724263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:51.724886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:51.732381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:51.733117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:51.733607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:51.734048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:51.882022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:51.890515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-36dd59bf-6c25-4cfd-aa1f-fe2e74118c14 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.170004 Jul 21 20:53:51.891180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 96/180] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:51 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:51.908983 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:51.909783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:51.916952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:51.917394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:51.918226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:51.918869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:52.067908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:52.076090 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-60ded482-b60f-4510-abd8-7611ae3c6ec3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.173273 Jul 21 20:53:52.076687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 85/181] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:51 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:52.582904 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:52.583498 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:52.590495 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:52.590927 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:52.591694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:52.592140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:52.732613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:52.746381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:52.749135 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:52.750523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-39de075b-7ed2-43f0-b449-09149ccb5124 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.171543 Jul 21 20:53:52.751802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 97/182] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:52 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:52.912465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:52.912988 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:52.919295 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:52.919772 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:52.920545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:52.920981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:53.068882 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:53.079516 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7c68efbe-327e-4482-82be-c0b5a6498b8b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.170917 Jul 21 20:53:53.080140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 86/183] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:52 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:53.093326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:53.093940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:53.100037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:53.100484 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:53.101285 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:53.101726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:53.242758 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:53.250837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fcac4c5c-57a6-4446-8819-501dc3a20ca2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.161491 Jul 21 20:53:53.251424 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 98/184] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:53 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:53.777492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:53.778544 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:53.787814 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:53.788261 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:53.790176 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:53.790618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:53.935062 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:53.943427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:53.944973 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:53.946150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-61179f3a-43d3-43f9-93a9-d15f150aeb6e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.175056 Jul 21 20:53:53.946839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 87/185] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:53 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:54.097897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:54.098520 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:54.105464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:54.105941 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:54.106720 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:54.107189 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:54.252246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:54.260948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8bc2f90d-ed62-4207-82c9-8d103bc17738 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.166805 Jul 21 20:53:54.261532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 99/186] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:54 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:54.269415 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:54.270016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:54.276935 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:54.277373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:54.278138 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:54.278559 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:54.432719 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:54.440392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4f11c39d-c74c-426c-8669-06474d6820df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.175245 Jul 21 20:53:54.440981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 88/187] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:54 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:54.964274 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:54.964885 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:54.971074 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:54.971527 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:54.972323 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:54.972761 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:55.114404 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:55.124210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:55.125658 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:55.127055 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4406b7ca-9993-49ba-a160-edb9486f71b7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.166999 Jul 21 20:53:55.127642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 100/188] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:54 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:55.278322 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:55.278928 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:55.285569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:55.286015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:55.286778 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:55.287203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:55.431405 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:55.439009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-50eb038b-461c-4a31-b404-05622b377df5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.164599 Jul 21 20:53:55.439586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 89/189] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:55 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:55.458494 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:55.459113 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:55.468656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:55.469094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:55.469860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:55.470284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:55.474566 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:53:55.610870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:55.619233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-359363f0-9e00-49d7-a2a6-2f8d2b09ad03 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.164666 Jul 21 20:53:55.619849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 101/190] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:55 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:56.145218 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:56.145847 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:56.152676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:56.153145 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:56.154323 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:56.154493 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:56.460279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:56.462017 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:56.468621 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:56.469114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:56.469946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:56.470268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:56.470707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:56.482641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:56.485130 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:56.486880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9dce7308-d267-4136-b310-a8c870003354 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.345511 Jul 21 20:53:56.487657 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 90/191] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:56 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:56.635960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:56.636996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:56.644829 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:56.645695 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:56.647505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:56.648555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:56.668107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:56.684272 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-915a7910-80c1-4cbf-9cda-72285834618c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.225811 Jul 21 20:53:56.695743 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 102/192] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:56 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:56.847202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:56.856555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-14aa264e-288b-4c18-befa-41a2dd1ea7e4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.224495 Jul 21 20:53:56.866085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 91/193] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:56 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:57.506412 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-16d385ae-29c8-4b5b-a858-d22842a16257 req-69543ab4-4b11-4117-87e3-bb6989841e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77154d49-ec36-4137-8c96-ceb20188d32e", "name": "network-vif-plugged", "status": "completed", "tag": "021cc3b8-5795-418d-85f7-7d0dcc124d4d"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:53:57.506993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:57.507384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:57.514927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:57.515369 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:57.516590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:57.517203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:57.519325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-16d385ae-29c8-4b5b-a858-d22842a16257 req-69543ab4-4b11-4117-87e3-bb6989841e0e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:57.520145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-16d385ae-29c8-4b5b-a858-d22842a16257 req-69543ab4-4b11-4117-87e3-bb6989841e0e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:57.540630 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-16d385ae-29c8-4b5b-a858-d22842a16257 req-69543ab4-4b11-4117-87e3-bb6989841e0e service nova] Creating event network-vif-plugged:021cc3b8-5795-418d-85f7-7d0dcc124d4d for instance 77154d49-ec36-4137-8c96-ceb20188d32e on hv-cinder-85068 Jul 21 20:53:57.552883 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-16d385ae-29c8-4b5b-a858-d22842a16257 req-69543ab4-4b11-4117-87e3-bb6989841e0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050051 Jul 21 20:53:57.552883 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 103/194] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:53:57.712359 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:57.712982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:57.714618 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:57.721658 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:57.723529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:57.724926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6484290e-13d4-47eb-93b7-dd931c70b17d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.223841 Jul 21 20:53:57.739486 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:57.740207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:57.740647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 92/195] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:57 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:57.741292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:57.741806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:57.877713 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:57.878713 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:57.895564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:57.896139 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:57.896832 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:57.897297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:57.919448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:57.929021 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e9d9cce6-4f22-424b-af9a-137ed83c4305 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.229271 Jul 21 20:53:57.933596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 104/196] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:57 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:58.072683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:58.081819 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fcf46ce2-d1cb-4422-af19-b5c771583d28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.210696 Jul 21 20:53:58.082420 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 93/197] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:57 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:58.750910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:58.751945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:58.760643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:58.761100 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:58.761889 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:58.762419 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:58.908095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:58.917509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:58.919773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:58.921543 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f8e47b21-f8ce-4dbb-86a2-97196c34b71b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.174964 Jul 21 20:53:58.922105 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 105/198] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:58 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:53:58.947802 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:58.948991 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:58.955473 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:58.955975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:58.956743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:58.957174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:59.100833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:59.102328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:59.113436 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:59.114079 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:59.115226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:59.115841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:59.159488 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:59.174088 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-36e2857c-6c57-46aa-95cd-aff892775cfa tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.230605 Jul 21 20:53:59.175545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 94/199] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:58 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:53:59.335000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:53:59.349132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f528872e-1697-4e04-ab47-ffc5673f26bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.252939 Jul 21 20:53:59.364256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 106/200] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:53:59 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:53:59.944203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:53:59.945050 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:53:59.956566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:59.957363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:59.957835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:53:59.958302 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:53:59.968948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:00.206441 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:00.207733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:00.221281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:00.222026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:00.223389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:00.224428 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:00.348515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:00.373310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:00.381573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:00.382543 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3ed05a0e-b3bd-49a2-a9d5-49eb0bf3434e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.443566 Jul 21 20:54:00.383461 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 95/201] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:53:59 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:54:00.396004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:00.402381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:00.414355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:00.414835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:00.421049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:00.421514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:00.501041 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:00.510087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1c418775-f502-4fb1-925f-e106a9265e1e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1314 microversion: 2.1 time: 0.307514 Jul 21 20:54:00.510693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 107/202] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:00 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:00.713326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:00.721677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bedfb9f7-43f7-4ca1-bb69-15ea91882f71 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.337493 Jul 21 20:54:00.722620 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 96/203] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:00 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:01.412573 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:01.413902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:01.432193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:01.432879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:01.433802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:01.434517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:01.527520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:01.528067 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:01.539389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:01.544454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:01.545530 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:01.552575 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:01.772217 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:01.787976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:01.792659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:01.794292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-98251bfe-8fca-4306-8352-726f89925c81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.396704 Jul 21 20:54:01.795706 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 108/204] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:54:01 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:54:01.806688 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:01.807295 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:01.815986 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:01.816726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:01.817872 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:01.818551 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:01.912044 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:01.925128 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6b1e13a2-a582-40c8-9167-fc8978825fd1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1502 microversion: 2.1 time: 0.401168 Jul 21 20:54:01.940690 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 97/205] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:01 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1502 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:02.059898 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:02.071150 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2fbe4b86-9bf1-4588-b11f-4d1e8e02f1c7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.270753 Jul 21 20:54:02.072602 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 109/206] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:01 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:02.816461 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:02.817805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:02.825897 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:02.826342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:02.827182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:02.827841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:03.046967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:03.056681 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:03.058480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:03.059870 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-863b5a98-c7cc-4602-8f68-1860dec50293 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.248966 Jul 21 20:54:03.060762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 98/207] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:54:02 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:54:03.094024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:03.096666 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:03.107320 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:03.108277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:03.109863 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:03.110596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:03.315892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:03.326928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f3afa975-5cbe-496d-a24b-c17d30a6b530 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.241926 Jul 21 20:54:03.327932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 110/208] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:03 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:04.078108 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:04.078720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:04.084823 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:04.086247 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:04.087160 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:04.090896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:04.249694 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:04.261638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:04.264460 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:04.268009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-488548e7-91fa-4605-bb56-20b8dda72ae8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.193719 Jul 21 20:54:04.269207 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 99/209] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:54:04 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:54:04.355477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:04.358084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:04.369787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:04.370602 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:04.371541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:04.372209 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:04.589106 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:04.598545 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e0e6342e-7051-482a-b8d6-29dea787e31a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.256179 Jul 21 20:54:04.599286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 111/210] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:04 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:04.672733 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-932d9e33-ddea-4691-ac47-2bf6092b45a1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "419a5bae-8185-4b82-812d-b1b1e86c3cdf"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:04.674216 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-932d9e33-ddea-4691-ac47-2bf6092b45a1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:04.681346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-932d9e33-ddea-4691-ac47-2bf6092b45a1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:04.681882 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-932d9e33-ddea-4691-ac47-2bf6092b45a1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:04.687656 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-932d9e33-ddea-4691-ac47-2bf6092b45a1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:04.693337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-932d9e33-ddea-4691-ac47-2bf6092b45a1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:05.294732 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:05.295559 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:05.302041 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:05.302570 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:05.303541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:05.304675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:05.462081 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:05.474226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:05.476626 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:05.478040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8253ffde-2d12-4c20-9943-bd2f7b7c8d8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.187190 Jul 21 20:54:05.479270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 112/211] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:54:05 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:54:05.618439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:05.619163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:05.629394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:05.632847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:05.647247 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:05.650511 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:05.981246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:05.992815 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-38cace57-f945-411d-bf5f-5d816f7bc961 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1322 microversion: 2.1 time: 0.376314 Jul 21 20:54:05.994109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 113/212] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:05 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:06.001476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-d367abab-db0a-4f60-a0ed-949d5d1f8f47 req-b680483a-a664-42d8-9d25-9afb7571e2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b1f12b-2ec1-4e9b-ac1b-61385f597069", "name": "network-vif-plugged", "status": "completed", "tag": "0a15578f-a527-4939-9a6b-ce6d94093a88"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:06.012461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-d367abab-db0a-4f60-a0ed-949d5d1f8f47 req-b680483a-a664-42d8-9d25-9afb7571e2c0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:06.013168 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-d367abab-db0a-4f60-a0ed-949d5d1f8f47 req-b680483a-a664-42d8-9d25-9afb7571e2c0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:06.026198 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-d367abab-db0a-4f60-a0ed-949d5d1f8f47 req-b680483a-a664-42d8-9d25-9afb7571e2c0 service nova] Creating event network-vif-plugged:0a15578f-a527-4939-9a6b-ce6d94093a88 for instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 on hv-cinder-85068 Jul 21 20:54:06.032928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-d367abab-db0a-4f60-a0ed-949d5d1f8f47 req-b680483a-a664-42d8-9d25-9afb7571e2c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036342 Jul 21 20:54:06.033831 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 114/213] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:54:06.180294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-932d9e33-ddea-4691-ac47-2bf6092b45a1 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "POST /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.510593 Jul 21 20:54:06.185988 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 100/214] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 20:54:04 2022] POST /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f/os-volume_attachments => generated 194 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:54:06.500675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:06.517080 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:06.546473 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:06.547244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:06.548054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:06.548689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:06.742763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:06.756136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:06.758267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:06.762907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-563835dd-5766-4700-9969-208d70608cad tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.267008 Jul 21 20:54:06.769218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 115/215] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:54:06 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:54:07.010628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:07.011492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:07.018097 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=74 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:07.021324 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.021786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.022571 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.023066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.244048 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:07.260360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-dbfff5b3-abbd-44f9-b467-b478830b86f4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1517 microversion: 2.1 time: 0.253787 Jul 21 20:54:07.261023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 101/216] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:07 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:07.278565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:07.279910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:07.286016 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.286754 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.287875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.288111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.375468 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lazy-loading 'flavor' on Instance uuid 77154d49-ec36-4137-8c96-ceb20188d32e {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:54:07.573100 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b1e4a8e7-5276-49b7-8a3d-0d1694089bb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e/action" status: 200 len: 32 microversion: 2.1 time: 0.298648 Jul 21 20:54:07.575322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 116/217] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 20:54:07 2022] POST /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:54:07.584143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:07.584888 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:07.593215 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.593967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.595466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.596302 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.777396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:07.787962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:07.789233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:07.793886 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f7e8365d-7216-4d43-9d14-66625af67f65 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.213949 Jul 21 20:54:07.794492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 102/218] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:07 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:07.798670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.799629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.800474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:07.800878 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:07.807435 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:08.055639 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:08.065994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:08.067488 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:08.077110 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-872ed168-0c6e-4b62-91f6-d1fe394fb2ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1406 microversion: 2.20 time: 0.289253 Jul 21 20:54:08.077796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 117/219] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:54:07 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:54:08.811603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:08.812276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:08.820063 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:08.820806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:08.821567 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:08.822391 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:09.014198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:09.031700 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0e418cb3-e1f4-4cca-9ada-6c255ae12a29 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.223617 Jul 21 20:54:09.033920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 103/220] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:08 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:09.100443 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:09.102490 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:09.114925 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:09.115910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:09.117952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:09.118770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:09.285529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:09.294929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:09.296463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:09.297643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-aa257fca-7ea9-4dc5-9efb-441e5a1f6289 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1597 microversion: 2.20 time: 0.205116 Jul 21 20:54:09.298210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 118/221] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:54:09 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1597 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:54:09.317059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c0a47c02-4c7f-442d-a2a5-ec015578c682 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:09.317573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c0a47c02-4c7f-442d-a2a5-ec015578c682 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:09.323865 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0a47c02-4c7f-442d-a2a5-ec015578c682 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:09.324307 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0a47c02-4c7f-442d-a2a5-ec015578c682 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:09.325071 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0a47c02-4c7f-442d-a2a5-ec015578c682 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:09.325499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0a47c02-4c7f-442d-a2a5-ec015578c682 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:09.424210 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c0a47c02-4c7f-442d-a2a5-ec015578c682 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111328 Jul 21 20:54:09.425099 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 104/222] 10.222.0.60 () {60 vars in 1315 bytes} [Thu Jul 21 20:54:09 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:54:10.050149 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:10.051419 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:10.059613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:10.060476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:10.061573 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:10.062536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:10.476085 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:10.488281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-256d8120-921a-49de-a0ac-67d00c733ec1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.442450 Jul 21 20:54:10.504420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 119/223] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:10 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:11.244377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-1e90f9f9-e312-4d99-a060-ac0ba1e7eac3 req-c0c95383-327f-48f5-a887-3ee2a6f16c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b1f12b-2ec1-4e9b-ac1b-61385f597069", "tag": "0a15578f-a527-4939-9a6b-ce6d94093a88"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:11.261320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-1e90f9f9-e312-4d99-a060-ac0ba1e7eac3 req-c0c95383-327f-48f5-a887-3ee2a6f16c5e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:11.262199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-1e90f9f9-e312-4d99-a060-ac0ba1e7eac3 req-c0c95383-327f-48f5-a887-3ee2a6f16c5e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:11.276582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-1e90f9f9-e312-4d99-a060-ac0ba1e7eac3 req-c0c95383-327f-48f5-a887-3ee2a6f16c5e service nova] Creating event network-changed:0a15578f-a527-4939-9a6b-ce6d94093a88 for instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 on hv-cinder-85068 Jul 21 20:54:11.283142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-1e90f9f9-e312-4d99-a060-ac0ba1e7eac3 req-c0c95383-327f-48f5-a887-3ee2a6f16c5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044054 Jul 21 20:54:11.284397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 105/224] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:54:11.514063 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:11.515478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:11.526043 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:11.528994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:11.532307 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:11.533190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:11.889377 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:11.902255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fac53948-b73c-49c3-9633-3680b401cf44 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.393384 Jul 21 20:54:11.906146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 120/225] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:11 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:12.923212 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:12.924524 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:12.941351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:12.950383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:12.951450 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:12.953589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:13.156697 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:13.166097 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-149f4ce3-3269-41b2-99d2-75efbcc29300 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.246897 Jul 21 20:54:13.167011 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 106/226] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:12 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:14.188504 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:14.190263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:14.197640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=70 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:14.203001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:14.203478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:14.204321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:14.204999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:14.410267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:14.420425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-769454f4-c84a-428c-aecc-e215b13e30f8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.241811 Jul 21 20:54:14.421776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 121/227] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:14 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:15.438418 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:15.439038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:15.446705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:15.447155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:15.447965 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:15.448407 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:15.590722 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:15.598177 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c2245e8a-d37c-4855-8a1a-faed0f54368d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.163622 Jul 21 20:54:15.599209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 107/228] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:15 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:16.617102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:16.618147 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:16.624253 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:16.624701 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:16.625459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:16.625891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:16.760675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:16.768448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0ac597ac-49b6-4de1-9838-9065c9bf6516 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.155752 Jul 21 20:54:16.769032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 122/229] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:16 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:17.785842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:17.786383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:17.793409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:17.793847 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:17.794592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:17.795018 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:17.925683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:17.933202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-298efc10-0d8a-443e-a9d3-f64707846a2b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.151293 Jul 21 20:54:17.933775 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 108/230] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:17 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:18.950653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:18.951256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:18.957394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:18.957835 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:18.958597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:18.959029 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:19.092178 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:19.099628 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a2ce4f48-58d0-4866-92cd-ee16900b6d78 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.152790 Jul 21 20:54:19.100228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 123/231] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:18 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:20.117501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:20.118116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:20.124808 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:20.125256 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:20.126028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:20.126459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:20.266806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:20.275236 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-92557fc3-9fc8-41d7-90a6-f7f27d54946e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.162081 Jul 21 20:54:20.275866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 109/232] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:20 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:21.292093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:21.293117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:21.301107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:21.301564 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:21.302458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:21.302775 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:21.443604 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:21.451492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a9c0a6b9-178f-481f-919e-cdee97f4c651 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.163337 Jul 21 20:54:21.452101 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 124/233] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:21 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:22.469994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:22.470626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:22.477591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:22.478030 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:22.478792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:22.479222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:22.626565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:22.635120 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-77abda86-d54b-4e94-b8d9-b1c9f8c670fd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.168861 Jul 21 20:54:22.635736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 110/234] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:22 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:23.654830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:23.655413 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:23.662257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:23.662720 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:23.664999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:23.665464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:23.821286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:23.839555 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-755f469a-48a6-46c3-a806-20983f4e7561 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.188656 Jul 21 20:54:23.840218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 125/235] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:23 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:24.778687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:24.779212 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:24.785860 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:24.786532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:24.787316 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:24.787769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:24.808949 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:24.817907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Going to try to terminate instance {{(pid=124647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:54:24.862463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:24.864086 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:24.872058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:24.872749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:24.873868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:24.874627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:24.962502 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-000948ee-c9b8-4859-9ba0-b9fd03ae4d87 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 204 len: 0 microversion: 2.1 time: 0.187528 Jul 21 20:54:24.963173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 111/236] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 20:54:24 2022] DELETE /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:54:24.982630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:24.984807 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:24.996960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:24.997556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:24.998435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:24.998995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:25.117991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:25.126480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2991094b-e4ce-4651-a9a4-65b0a071efcd tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.270335 Jul 21 20:54:25.127312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 126/237] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:24 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:25.269300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:25.284078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2f0e2e82-b6a1-4d47-9334-3d1f71a2c7e5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.316139 Jul 21 20:54:25.284704 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 112/238] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:24 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:26.143936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:26.144784 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:26.151653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:26.152127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:26.152913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:26.153518 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:26.302950 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:26.303563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:26.311781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:26.312640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:26.313677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:26.314193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:26.319568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:26.341185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1cc45bb6-55d6-4b96-bce7-dee60e2273d1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.201184 Jul 21 20:54:26.349629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 127/239] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:26 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:26.472416 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:26.482490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-535d90c7-248d-4fda-b681-0f1a7a24b7e3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.183306 Jul 21 20:54:26.483696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 113/240] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:26 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:27.361650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:27.362651 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:27.369303 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:27.370227 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:27.370505 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:27.370933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:27.501517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:27.502960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:27.509985 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:27.510668 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:27.512005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:27.512490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:27.515109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:27.523404 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1094828e-6b8b-401a-8c51-1cddcfc3e08b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.166281 Jul 21 20:54:27.532605 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 128/241] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:27 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:27.680056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:27.688469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-00ff3420-c757-4e99-a0f9-49a609814277 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.191385 Jul 21 20:54:27.689253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 114/242] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:27 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:28.541312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:28.541829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:28.547866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:28.548313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:28.549075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:28.549510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:28.700383 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:28.705682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:28.706439 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:28.708123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-047c33b2-caf8-494c-b1a6-9c6ba6803ab1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.171502 Jul 21 20:54:28.708718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 129/243] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:28 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:28.713476 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:28.713931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:28.714710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:28.715144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:28.863180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:28.873325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e5e03d2c-8659-4168-8f95-ae200b85e88c tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.171493 Jul 21 20:54:28.873992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 115/244] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:28 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:29.727815 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:29.728459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:29.734800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:29.735249 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:29.736329 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:29.736888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:29.876032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:29.885871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-539e0c85-792d-4835-a002-0650c2ba601e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.163448 Jul 21 20:54:29.886721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 130/245] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:29 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:29.899381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:29.900020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:29.906414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:29.906932 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:29.908089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:29.908559 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:30.060593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:30.068567 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-73297e1c-c05c-4e86-8552-874173dff730 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.181990 Jul 21 20:54:30.069156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 116/246] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:29 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:30.903029 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:30.903537 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:30.911339 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:30.911897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:30.912740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:30.914034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:31.070217 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:31.081109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-73bb23b6-9e28-4991-aac0-1a14cc1ffb6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.181697 Jul 21 20:54:31.088618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:31.089251 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:31.092396 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 131/247] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:30 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:31.099196 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:31.099861 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:31.101457 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:31.102034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:31.291247 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:31.299750 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-856f6ee5-ce68-4fcb-b515-b354ea090ddf tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.216895 Jul 21 20:54:31.300439 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 117/248] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:31 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:32.109191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:32.110038 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:32.117013 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:32.117461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:32.118228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:32.118665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:32.316222 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:32.320065 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:32.320852 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:32.326316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-63eb6a2f-890b-4554-9e77-23368091baae tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.221110 Jul 21 20:54:32.327231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 132/249] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:32 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:32.329170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:32.329826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:32.330612 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:32.331060 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:32.504343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:32.513394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ad374c83-7ad9-415c-beec-3feef0ae7573 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.198664 Jul 21 20:54:32.513986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 118/250] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:32 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:33.344915 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:33.345610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:33.353904 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:33.354278 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:33.355072 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:33.355506 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:33.532184 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:33.532898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:33.540108 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:33.540667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:33.541498 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:33.542004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:33.621600 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:33.625281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:33.638436 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fc708e9c-38e2-4968-a6ea-59a9aa96275e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.297568 Jul 21 20:54:33.639027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 133/251] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:33 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:33.740253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:33.750273 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ea35f0d2-fd1f-4688-beb4-4b24dc4c4f8f tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.221924 Jul 21 20:54:33.751249 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 119/252] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:33 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:34.655896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:34.656426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:34.662681 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:34.663310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:34.664088 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:34.664518 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:34.782626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:34.783554 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:34.792238 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:34.792958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:34.794373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:34.795006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:34.863516 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:34.872736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7145e145-ca02-4005-aadb-e08d8c60b89b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.220766 Jul 21 20:54:34.873314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 134/253] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:34 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:34.957481 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:34.965896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-07b3482a-0aeb-42c5-8557-f6071f6258c4 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.187818 Jul 21 20:54:34.966486 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 120/254] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:34 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:35.890196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:35.890811 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:35.896779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:35.897813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:35.898682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:35.899123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:35.983080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:35.983838 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:35.990620 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:35.991123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:35.991992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:35.992425 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:36.033372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:36.041676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-89255ff2-bc65-40f0-92b7-b139af42f3bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.155281 Jul 21 20:54:36.042353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 135/255] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:35 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:36.123150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:36.131006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b02b6fbd-8c5a-442b-b3da-0d79138a0d19 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.152217 Jul 21 20:54:36.131597 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 121/256] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:35 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:37.060585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:37.061333 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:37.067136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:37.067575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:37.068369 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:37.068800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:37.156389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:37.157541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:37.161248 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:37.168386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:37.168918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:37.169766 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:37.170191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:37.210553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:37.218390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-45bb94a1-63eb-4173-8d36-769ffe1a8ea1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.163067 Jul 21 20:54:37.218955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 136/257] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:37 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:37.313566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:37.322384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c98dcc71-e539-4f48-9d54-f20c1f568fe3 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.172233 Jul 21 20:54:37.322967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 122/258] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:37 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:38.237841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:38.238459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:38.244987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:38.245568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:38.246353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:38.246677 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:38.338939 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:38.339647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:38.345946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:38.346397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:38.347165 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:38.347617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:38.498897 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:38.517382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8fe7718b-c134-4a65-86f3-dba4fc15633a tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1554 microversion: 2.1 time: 0.182689 Jul 21 20:54:38.518248 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 123/259] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:38 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:38.530180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:38.538616 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-63f269f3-7d77-4161-9ec7-fb9945e4136c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.304789 Jul 21 20:54:38.539401 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 137/260] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:38 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:38.970395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-b6461cac-102c-400d-8a24-50888e9045d3 req-7208491a-cb9a-4743-9e6e-e82999e92700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b881a042-84ac-4864-9004-f1f385293d9f", "name": "network-vif-deleted", "tag": "a6fd06b5-db86-4220-918a-dca146cd3b1a"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:38.985156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-b6461cac-102c-400d-8a24-50888e9045d3 req-7208491a-cb9a-4743-9e6e-e82999e92700 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:38.985833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-b6461cac-102c-400d-8a24-50888e9045d3 req-7208491a-cb9a-4743-9e6e-e82999e92700 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:39.005087 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-b6461cac-102c-400d-8a24-50888e9045d3 req-7208491a-cb9a-4743-9e6e-e82999e92700 service nova] Creating event network-vif-deleted:a6fd06b5-db86-4220-918a-dca146cd3b1a for instance b881a042-84ac-4864-9004-f1f385293d9f on hv-cinder-85068 Jul 21 20:54:39.012707 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-b6461cac-102c-400d-8a24-50888e9045d3 req-7208491a-cb9a-4743-9e6e-e82999e92700 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044625 Jul 21 20:54:39.013813 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 124/261] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:54:39.535875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:39.536600 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:39.549623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:39.549623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:39.549623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:39.549623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:39.558286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:39.560326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:39.566994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:39.568012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:39.569587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:39.570259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:39.644091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6b0bfbda8944369d1a83b52b400f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe52006c5034bbf8de92b8aae171d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:39.653810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-793dc7ac-eacd-4b4d-a510-c070c07e7129 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 200 len: 1345 microversion: 2.1 time: 0.122004 Jul 21 20:54:39.654395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 138/262] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:39 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 1345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:39.728522 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:39.736285 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3caed9ef-6930-407a-9273-9a68aa2c6f73 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.182672 Jul 21 20:54:39.736784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 125/263] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:39 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:40.671370 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:40.672017 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:40.678194 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:40.679209 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:40.680010 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:40.680446 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:40.694679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] HTTP exception thrown: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Request method failure captured: Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f HTTP/1.1 Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byUy9zyvkwc4eSX8bC3mw7xlExB7igC4NdMXOXWUiS5DIFSwV1kVVlDrSrDihkDFDgHyqIM_N1zUE44RVvw8i3bTOmlIN7XMLPLUDhdE4GuvD5TrFGFHrnkKrvvVik_qFtcXTVLpFMmyFvRMBRFfrdmWMS1ykZ8HayUT-WcB8ZnQnI Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:54:40.699336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: bc6b0bfbda8944369d1a83b52b400f64 Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.700776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'b881a042-84ac-4864-9004-f1f385293d9f'} Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:54:40.701580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.702675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.703943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Returning 404 to user: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:54:40.703943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cd46b29b-ad4d-468a-a538-15939c6fa8a5 tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 404 len: 111 microversion: 2.1 time: 0.033240 Jul 21 20:54:40.703943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 139/264] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:40 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:54:40.753659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:40.754304 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:40.760881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:40.761335 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:40.762186 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:40.762728 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:40.807673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:40.808649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:40.814749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:40.815194 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:40.816022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:40.816449 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:40.831245 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] HTTP exception thrown: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Request method failure captured: Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f/os-volume_attachments HTTP/1.1 Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byUy9zyvkwc4eSX8bC3mw7xlExB7igC4NdMXOXWUiS5DIFSwV1kVVlDrSrDihkDFDgHyqIM_N1zUE44RVvw8i3bTOmlIN7XMLPLUDhdE4GuvD5TrFGFHrnkKrvvVik_qFtcXTVLpFMmyFvRMBRFfrdmWMS1ykZ8HayUT-WcB8ZnQnI Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:54:40.832813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: bc6b0bfbda8944369d1a83b52b400f64 Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.834166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'server_id': 'b881a042-84ac-4864-9004-f1f385293d9f'} Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:54:40.834879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:40.836301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:54:40.838785 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Returning 404 to user: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:54:40.838785 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-32cd4e26-c28f-4165-ba75-f8349a7ad59b tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031696 Jul 21 20:54:40.838785 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 140/265] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 20:54:40 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:54:40.903319 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:40.912346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-33aa81de-0c22-49d9-a0d8-6c3b3a04e58d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.162695 Jul 21 20:54:40.912981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 126/266] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:40 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:41.930336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:41.931076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:41.937275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:41.937729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:41.938499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:41.938935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:42.049910 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:42.050684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:42.057340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:42.057783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:42.058554 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:42.058992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:42.063214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:42.074767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] HTTP exception thrown: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Request method failure captured: Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: DELETE /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f HTTP/1.1 Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2byUy9zyvkwc4eSX8bC3mw7xlExB7igC4NdMXOXWUiS5DIFSwV1kVVlDrSrDihkDFDgHyqIM_N1zUE44RVvw8i3bTOmlIN7XMLPLUDhdE4GuvD5TrFGFHrnkKrvvVik_qFtcXTVLpFMmyFvRMBRFfrdmWMS1ykZ8HayUT-WcB8ZnQnI Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 20:54:42.079907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: bc6b0bfbda8944369d1a83b52b400f64 Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.081297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'b881a042-84ac-4864-9004-f1f385293d9f'} Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:54:42.082202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.083464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.084996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Returning 404 to user: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:54:42.085189 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:42.085300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5c80bc82-2fba-445f-bad9-acf24ed7209e tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 404 len: 111 microversion: 2.1 time: 0.035611 Jul 21 20:54:42.085495 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 127/267] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 20:54:42 2022] DELETE /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:54:42.091261 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:42.091836 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9ca6cd93-0e4d-4f6d-a1ec-c92bdfe71337 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.165720 Jul 21 20:54:42.091946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] [instance: b881a042-84ac-4864-9004-f1f385293d9f] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:42.092788 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 141/268] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:41 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:42.099849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:42.099849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:42.100503 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:42.100937 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:42.116491 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] HTTP exception thrown: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Request method failure captured: Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f HTTP/1.1 Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2byUy9zyvkwc4eSX8bC3mw7xlExB7igC4NdMXOXWUiS5DIFSwV1kVVlDrSrDihkDFDgHyqIM_N1zUE44RVvw8i3bTOmlIN7XMLPLUDhdE4GuvD5TrFGFHrnkKrvvVik_qFtcXTVLpFMmyFvRMBRFfrdmWMS1ykZ8HayUT-WcB8ZnQnI Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 20:54:42.118336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4fe52006c5034bbf8de92b8aae171d3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 4fe52006c5034bbf8de92b8aae171d3c Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-DeleteServersTestJSON-1756981681 Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: bc6b0bfbda8944369d1a83b52b400f64 Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-DeleteServersTestJSON-1756981681-project Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.120014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'b881a042-84ac-4864-9004-f1f385293d9f'} Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:54:42.120859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. Jul 21 20:54:42.122222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:54:42.123490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] Returning 404 to user: Instance b881a042-84ac-4864-9004-f1f385293d9f could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:54:42.123490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cebea1bc-f17a-41f5-8d4f-0f8975c380ee tempest-DeleteServersTestJSON-1756981681 tempest-DeleteServersTestJSON-1756981681-project] 10.222.0.60 "GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f" status: 404 len: 111 microversion: 2.1 time: 0.033405 Jul 21 20:54:42.123490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 128/269] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:42 2022] GET /compute/v2.1/servers/b881a042-84ac-4864-9004-f1f385293d9f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:54:43.112575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:43.113251 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:43.125720 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:43.126408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:43.127325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:43.127946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:43.342033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:43.351869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e6197835-db23-41a0-8aba-46c0545149bf tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.245157 Jul 21 20:54:43.362023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 142/270] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:43 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:44.375462 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:44.376831 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:44.403402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:44.406206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:44.408262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:44.410166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:44.658806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:44.673192 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-04c7e01c-b1e0-4648-8f05-1c317a799e5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.304789 Jul 21 20:54:44.686083 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 129/271] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:44 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:45.695233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:45.699028 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:45.706056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=44 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:45.718303 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:45.718760 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:45.719561 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:45.720027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:45.968357 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:45.981869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-92fb6868-8625-461d-8eae-b220b53a32bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.289121 Jul 21 20:54:45.983081 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 143/272] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:45 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:47.004657 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:47.007837 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:47.016446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:47.017442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:47.018398 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:47.019038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:47.284835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:47.293361 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-20ea7f0e-8a60-4d48-8b89-03dc582f4e97 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.295596 Jul 21 20:54:47.293957 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 130/273] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:46 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:48.310903 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:48.311634 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:48.320467 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:48.320991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:48.321851 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:48.323571 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:48.579655 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:48.591287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5ffe856e-6cdc-45d0-b263-a36daa268631 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.284125 Jul 21 20:54:48.592058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 144/274] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:48 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:49.568345 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-438958725", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:49.612365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:49.613928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:49.622860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:49.624059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:49.625697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:49.628596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:49.995054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:50.016180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4df369d5-85a0-4aa8-80b5-8ec1a0b12e15 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.408906 Jul 21 20:54:50.016787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 145/275] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:49 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:51.034692 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:51.035378 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:51.043536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:51.043991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:51.044759 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:51.045189 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:51.287876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:51.313345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-66375c23-0016-4638-94aa-53bc30629f26 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.278363 Jul 21 20:54:51.314008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 146/276] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:51 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:52.332654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:52.334898 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:52.365467 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:52.367106 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:52.369008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:52.369844 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:52.594335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:52.609180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-27e8f633-26af-4c2e-ae21-8b5d926da0a4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.282434 Jul 21 20:54:52.625494 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 147/277] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:52 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:52.644602 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] validate_networks() for None {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:54:53.555077 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:54:53.555743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:54:53.556373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:54:53.556931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:54:53.557499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:54:53.567940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:53.568395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:53.569619 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:53.570286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:53.595046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Getting quotas for project a0f56ad01c544c958f8e65367ff5c575. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:54:53.603899 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Getting quotas for user 5c6e45e0cb81448baaae7d4f2ccd5d28 and project a0f56ad01c544c958f8e65367ff5c575. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:54:53.627516 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:54:53.629913 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:54:53.640980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:53.642026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:53.653256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:53.653907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:53.654905 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:53.655302 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:53.733798 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d0f4257d-2a94-45c1-9bf5-b14d5eb3b4f5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.168947 Jul 21 20:54:53.735743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 131/278] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:54:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:54:53.768390 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8ffb6c02-ab32-4299-a729-1dfddd2f7869 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:53.769539 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8ffb6c02-ab32-4299-a729-1dfddd2f7869 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:53.913930 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:53.933709 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8ffb6c02-ab32-4299-a729-1dfddd2f7869 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:53.935184 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-24b83aed-0ca8-46dc-9fee-1c9e0cbae35f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.303426 Jul 21 20:54:53.936580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 148/279] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:53 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:53.945327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8ffb6c02-ab32-4299-a729-1dfddd2f7869 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1214 microversion: 2.1 time: 0.195654 Jul 21 20:54:53.947900 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 132/280] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:53 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:54.438568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-497e1ee8-cd87-417a-bc76-fe5b6f86d9bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'create', calling method: .version_select at 0x7f354160c0d0>, body: {"keypair": {"name": "tempest-keypair-1310789252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5+7A5nGcHz0HRzaHy3S3SxGupuk8BlWphhaZ0gscJrs7JX5NOtIpsh8AZtLejSe7fJm+BKwjc1EySIksvjNGj3nqgixO63mGhCBLmF7CWCa7RXNGLJda0IYJND1x6hbg=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:54.477907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-497e1ee8-cd87-417a-bc76-fe5b6f86d9bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for project c51d3542adae4062a487ab85d673140d. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:54:54.483433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-497e1ee8-cd87-417a-bc76-fe5b6f86d9bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for user ab2bc1eb1eb845ec82b79adee04a51e7 and project c51d3542adae4062a487ab85d673140d. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:54:54.523754 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-497e1ee8-cd87-417a-bc76-fe5b6f86d9bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.293275 Jul 21 20:54:54.524370 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 149/281] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 20:54:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:54:54.954890 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:54.955435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:54.962947 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:54.963395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:54.964316 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:54.964751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:54.972250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:54.973714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:54.982291 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:54.982906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:54.984181 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:54.985507 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:55.064711 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:55.074213 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8f87996f-fd23-4334-b5e5-83e450dfc95e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1218 microversion: 2.1 time: 0.113012 Jul 21 20:54:55.080253 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 150/282] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:54 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:55.209958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:55.218034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b31af9f4-344d-4b8c-bb04-956d28463cce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.267132 Jul 21 20:54:55.218626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 133/283] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:54 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:56.102735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:56.105475 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:56.116635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:56.117882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:56.120094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:56.121430 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:56.248783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:56.249936 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:56.261477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:56.274340 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8a5ea8f3-7de6-4fdc-b2bb-73e8853fa2c5 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1266 microversion: 2.1 time: 0.185660 Jul 21 20:54:56.276983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 151/284] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:56 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:56.292025 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:56.292518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:56.293314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:56.293755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:56.296360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2005837863", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfa25da3-fc72-46d1-8f85-10482d1b770c"}], "security_groups": [{"name": "tempest-securitygroup--1164346259"}], "key_name": "tempest-keypair-1310789252", "user_data": "}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:54:56.704948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:56.719200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e9ad8d34-25b1-4c5e-b751-2ec8f9f0f9ef tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.477456 Jul 21 20:54:56.721677 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] validate_networks() for [('cfa25da3-fc72-46d1-8f85-10482d1b770c', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:54:56.745074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 134/285] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:56 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:57.304848 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:57.306434 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:57.324030 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:57.324873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:57.325621 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:57.327892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:57.479411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:57.494244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cd08aa5d-8725-4a3d-8e78-bfb503df3eca tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1274 microversion: 2.1 time: 0.197094 Jul 21 20:54:57.494838 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 135/286] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:57 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:57.750388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:57.751267 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:57.761318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:57.761763 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:57.762901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:57.768876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:58.002566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:58.014041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8b1eac9d-d91f-4220-9f7d-10bac02706ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1523 microversion: 2.1 time: 0.267433 Jul 21 20:54:58.019779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 136/287] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:57 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:58.187430 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:54:58.188013 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:54:58.188490 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:54:58.188892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:54:58.189316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:54:58.200090 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:58.200534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:58.201423 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:58.201865 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:58.251341 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for project c51d3542adae4062a487ab85d673140d. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:54:58.266296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for user ab2bc1eb1eb845ec82b79adee04a51e7 and project c51d3542adae4062a487ab85d673140d. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:54:58.308219 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:54:58.313466 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:54:58.428445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9200d173-bad5-46d6-a774-7101316b9df3 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.136497 Jul 21 20:54:58.435513 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 152/288] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:54:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:54:58.440800 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f6067291-68cd-4cfb-b368-3b26d9385660 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:58.442856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f6067291-68cd-4cfb-b368-3b26d9385660 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:58.515969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:58.517141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:58.532335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:58.533081 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:58.534024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:58.537454 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:58.544432 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f6067291-68cd-4cfb-b368-3b26d9385660 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:58.555540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f6067291-68cd-4cfb-b368-3b26d9385660 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1238 microversion: 2.1 time: 0.119895 Jul 21 20:54:58.559222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 137/289] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:58 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:58.594630 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:54:58.712132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:58.736960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8cbcff76-3f5e-4937-9975-0c2b3387ea2b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1272 microversion: 2.1 time: 0.228945 Jul 21 20:54:58.751832 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 153/290] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:58 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:59.032532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:59.033691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:59.042895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.043801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:59.045918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.046511 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:59.281979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:59.290852 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-79d3ab63-5d56-4bca-9c4a-23ba0cc7fdc9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1503 microversion: 2.1 time: 0.263790 Jul 21 20:54:59.291534 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 138/291] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:59 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:54:59.313509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:59.314659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:59.323641 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.324215 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:59.325186 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.325584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:59.577066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:59.578509 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:59.586993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.588184 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:59.589500 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.591006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:59.683737 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:59.702635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f4981c4b-3d2e-4a41-9a8b-8c5663898aad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1517 microversion: 2.1 time: 0.393533 Jul 21 20:54:59.706534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 154/292] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:59 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1517 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:59.721436 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:54:59.731841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ba2b6a7c-8e81-4ba3-b6b3-da4808e39057 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1234 microversion: 2.1 time: 0.159821 Jul 21 20:54:59.732996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 139/293] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:59 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1234 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:54:59.757966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:54:59.758566 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:54:59.765061 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.765752 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:54:59.766683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:54:59.767266 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:00.165463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:00.177155 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ca68f7ea-f208-4e88-bd41-73de0ba0f88f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.423712 Jul 21 20:55:00.180680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 155/294] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:54:59 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:00.680593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-85e8d4eb-a8ec-484d-b7be-508eddfe2d59 req-8020736e-28d8-46e6-9f26-8218e427a673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fdd0733-50ba-4256-ab59-8f480c117c13", "tag": "bef5d58c-c94f-4a10-9331-5b8e41b40151"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:00.697652 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-85e8d4eb-a8ec-484d-b7be-508eddfe2d59 req-8020736e-28d8-46e6-9f26-8218e427a673 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:00.698455 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-85e8d4eb-a8ec-484d-b7be-508eddfe2d59 req-8020736e-28d8-46e6-9f26-8218e427a673 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:00.721456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-85e8d4eb-a8ec-484d-b7be-508eddfe2d59 req-8020736e-28d8-46e6-9f26-8218e427a673 service nova] Creating event network-changed:bef5d58c-c94f-4a10-9331-5b8e41b40151 for instance 9fdd0733-50ba-4256-ab59-8f480c117c13 on hv-cinder-85068 Jul 21 20:55:00.728451 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-85e8d4eb-a8ec-484d-b7be-508eddfe2d59 req-8020736e-28d8-46e6-9f26-8218e427a673 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054913 Jul 21 20:55:00.734165 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 140/295] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:00.762607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:00.763478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:00.776631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:00.777414 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:00.778679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:00.779450 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:00.953873 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:00.964489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f529ba87-3571-4295-b04d-bc74f687479a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1296 microversion: 2.1 time: 0.217526 Jul 21 20:55:00.965846 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 156/296] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:00 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1296 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:01.196762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:01.198427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:01.217134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:01.218037 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:01.219412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:01.220336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:01.484641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:01.494377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f461541f-6792-4247-88f5-543eef0ffc61 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.303294 Jul 21 20:55:01.506843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 141/297] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:01 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:01.987478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:01.988127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:01.994723 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:01.995178 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:01.995983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:01.996423 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:02.152185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:02.163075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-82a1bf74-b610-4eca-b87e-42e912fb3efe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.179834 Jul 21 20:55:02.164200 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 157/298] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:01 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:02.328884 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-b5ae26c7-823d-4223-b779-1fead1e7f61a req-120936f1-9ad7-4b7a-a29e-19ed4e3a34aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a0918b-9ae2-48d6-943a-bff67b0e7ca6", "tag": "3d26f1bb-0cc8-4534-94aa-7d6db164e0dd"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:02.339744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-b5ae26c7-823d-4223-b779-1fead1e7f61a req-120936f1-9ad7-4b7a-a29e-19ed4e3a34aa service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:02.340204 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-b5ae26c7-823d-4223-b779-1fead1e7f61a req-120936f1-9ad7-4b7a-a29e-19ed4e3a34aa service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:02.354094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-b5ae26c7-823d-4223-b779-1fead1e7f61a req-120936f1-9ad7-4b7a-a29e-19ed4e3a34aa service nova] Creating event network-changed:3d26f1bb-0cc8-4534-94aa-7d6db164e0dd for instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 on hv-cinder-85068 Jul 21 20:55:02.359632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-b5ae26c7-823d-4223-b779-1fead1e7f61a req-120936f1-9ad7-4b7a-a29e-19ed4e3a34aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034515 Jul 21 20:55:02.360592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 142/299] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:55:02.512951 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:02.513685 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:02.519816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:02.520258 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:02.521126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:02.521589 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:02.656709 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:02.665338 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c711b160-06d3-4d88-bfc0-3134887ec1c9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.156180 Jul 21 20:55:02.665915 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 158/300] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:02 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:03.182132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:03.182813 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:03.189017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.189455 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.190208 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.190635 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.336957 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:03.344260 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d7ddf74b-d1ee-4013-87f6-670730488728 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.167068 Jul 21 20:55:03.344837 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 143/301] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:03 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:03.400212 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:03.401220 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:03.407219 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.407665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.408542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.408972 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.434840 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lazy-loading 'flavor' on Instance uuid 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:55:03.506743 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c7bb86c9-fefa-4243-92d5-60bcfd6fdb94 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd/action" status: 200 len: 32 microversion: 2.1 time: 0.110212 Jul 21 20:55:03.507350 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 159/302] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 20:55:03 2022] POST /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:55:03.516638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:03.517156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:03.523941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.524388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.525141 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.525578 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.580122 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:03.662378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:03.671130 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4c53690a-6533-4d7c-8820-9441d2dd55e0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.158199 Jul 21 20:55:03.671749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 144/303] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:03 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:03.683358 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:03.684084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:03.690469 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.690921 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.691696 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:03.692159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:03.845611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:03.854525 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6a77f70f-803e-4d0b-80b2-5097c6c67888 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.175282 Jul 21 20:55:03.855107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 160/304] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:03 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:04.361529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:04.362140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:04.368725 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:04.369170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:04.369930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:04.370362 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:04.510687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:04.518859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-27ad2892-6fbe-4311-a66e-49d95e6f133b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.161471 Jul 21 20:55:04.519442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 145/305] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:04 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:04.687826 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:04.688442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:04.694945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:04.695390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:04.696190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:04.696625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:04.833002 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:04.841435 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-adb07332-5cdc-4e40-b985-a09ba2ef5bf9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.157507 Jul 21 20:55:04.842008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 161/306] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:04 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:04.874289 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:04.874289 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:04.878650 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:04.879110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:04.879936 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:04.880381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:05.027259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:05.035064 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c1042244-5419-4f9c-8f06-c296e4304a4d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.167143 Jul 21 20:55:05.035751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 146/307] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:04 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:05.536736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:05.538375 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:05.544699 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:05.545147 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:05.545921 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:05.546352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:05.693468 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:05.702361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5344fd71-6a0f-4298-936e-ead107559c65 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.169359 Jul 21 20:55:05.703358 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 162/308] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:05 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:05.858789 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:05.859405 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:05.867334 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:05.867843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:05.868638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:05.869070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:06.005077 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:06.013199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-24251977-439f-44d5-89c4-512b6a826685 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.158272 Jul 21 20:55:06.013771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 147/309] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:05 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:06.053176 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:06.053779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:06.059937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:06.060384 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:06.061158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:06.061591 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:06.205928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:06.214324 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f3fc142f-499a-4791-88bf-c0723b287a5e tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.164949 Jul 21 20:55:06.214912 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 163/310] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:06 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:06.718901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:06.719519 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:06.726427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:06.726966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:06.727662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:06.728129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:06.874727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:06.883244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8381820a-d0c9-4801-9181-877c38c94288 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.168011 Jul 21 20:55:06.884023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 148/311] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:06 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:07.030749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:07.031353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:07.038390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:07.038829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:07.039593 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:07.040052 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:07.230751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:07.231275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:07.233173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:07.239350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:07.239826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:07.241124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:07.241554 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:07.246455 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:07.319300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:07.328066 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-125ad4e3-94ce-4bbe-a490-bc4ebbdff2ad tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.300990 Jul 21 20:55:07.328961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 164/312] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:07 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:07.386913 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:07.394702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-48c97d67-3cec-4c41-8c1e-2fe51f54f14f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.167968 Jul 21 20:55:07.395339 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 149/313] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:07 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:07.901144 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:07.902010 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:07.908589 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:07.909027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:07.909789 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:07.910217 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:08.053975 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:08.061557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9e0f9bf2-8741-4389-a692-8da6fc674e14 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.164339 Jul 21 20:55:08.062143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 165/314] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:07 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:08.345852 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:08.346467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:08.353815 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:08.354267 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:08.355036 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:08.355478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:08.413297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:08.413950 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:08.417649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:08.418186 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=10 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:08.422870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:08.423321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:08.424130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:08.424570 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:08.485937 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:08.495994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-18c63941-4971-4e8a-9650-8b8bd1ce7f9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.153935 Jul 21 20:55:08.496815 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 150/315] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:08 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:08.556251 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:08.563960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d7e87bbb-6c94-4f09-9b8f-e19aded0b434 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.155156 Jul 21 20:55:08.564524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 166/316] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:08 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:09.079140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:09.079781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:09.081641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=10 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:09.087497 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:09.087975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:09.088748 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:09.089183 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:09.230450 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:09.238388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-66130b69-4c2d-439b-9866-de5b3ac322f9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.163112 Jul 21 20:55:09.238973 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 151/317] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:09 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:09.512837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:09.513451 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:09.519553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:09.520050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:09.520810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:09.521313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:09.580679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:09.581356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:09.588972 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:09.589428 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:09.590205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:09.590647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:09.668609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:09.676557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-211422de-7f4f-4a7e-b23e-ac425a91a335 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.167523 Jul 21 20:55:09.677196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 167/318] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:09 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:09.729660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:09.737665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-72b5ba25-dfb9-431b-b69f-01f3e4d9c0bd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.160823 Jul 21 20:55:09.738248 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 152/319] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:09 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:10.255606 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:10.256675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:10.262959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:10.263400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:10.264210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:10.264647 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:10.268845 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:10.409520 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:10.418080 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d5a9c1fa-33e7-49f8-84c0-072bef05cb8a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.166341 Jul 21 20:55:10.418658 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 168/320] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:10 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:10.692869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:10.694117 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:10.700797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:10.701252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:10.702035 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:10.702474 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:10.754274 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:10.754891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:10.762322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:10.762765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:10.763539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:10.764003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:10.846834 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:10.855254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-37eb9edd-4c8e-482a-a944-9ab7f2c3af88 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.166204 Jul 21 20:55:10.856072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 153/321] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:10 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:10.906350 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:10.918699 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e82935b0-8eb5-43d3-8c24-9c1e2770d176 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.167832 Jul 21 20:55:10.919539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 169/322] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:10 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:11.435000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:11.435616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:11.441765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:11.442220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:11.442988 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:11.443667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:11.571662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:11.579133 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-09540b63-0d05-4b9a-969f-9eee16c8898d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.148036 Jul 21 20:55:11.579746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 154/323] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:11 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:11.872522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:11.873209 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:11.879357 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:11.879867 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:11.881281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:11.881726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:11.942371 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:11.943142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:11.953976 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:11.954426 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:11.955277 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:11.955744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:12.049523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:12.059585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-90670b81-13d4-491f-8f2e-d556254bfdd9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.190769 Jul 21 20:55:12.060400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 170/324] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:11 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:12.105567 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:12.115546 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bcc76d81-8116-4a37-b9ed-1e3461419f68 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.177492 Jul 21 20:55:12.116633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 155/325] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:11 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:12.596948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:12.597578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:12.603692 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:12.604159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:12.604923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:12.605356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:12.737248 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:12.745012 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-317787d4-cb44-4003-8426-11b1b204bc03 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.151883 Jul 21 20:55:12.745583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 171/326] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:12 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:13.077647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:13.078244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:13.086111 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:13.086800 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:13.087890 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:13.089066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:13.147992 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:13.149296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:13.158191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:13.160295 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:13.161327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:13.162009 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:13.374616 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:13.387321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d893e9f6-e1d4-4fea-90eb-7c0a02c75679 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.250386 Jul 21 20:55:13.387959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 172/327] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:13 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:13.516370 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:13.526094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-874efe73-9189-4a53-b627-c3e06b80e69c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.452392 Jul 21 20:55:13.526683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 156/328] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:13 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:13.762227 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:13.762838 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:13.769276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:13.769727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:13.770497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:13.770936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:13.907140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:13.917532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c3af34fc-331e-4f23-a3d2-913b7e379585 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.159107 Jul 21 20:55:13.918154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 173/329] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:13 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:14.408647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:14.409406 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:14.416739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:14.417198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:14.418160 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:14.418868 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:14.542413 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:14.543023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:14.549311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:14.549747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:14.550523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:14.550955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:14.738352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:14.747454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-131a95ea-3063-47e6-a640-090a69a04a56 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.343227 Jul 21 20:55:14.748549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 157/330] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:14 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:14.823123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:14.830729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3710915d-b0fd-4cb4-adc7-b46550876d95 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.292181 Jul 21 20:55:14.840577 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 174/331] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:14 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:14.935700 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:14.936334 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:14.942596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:14.943211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:14.944012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:14.944445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:15.093447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:15.102067 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3205306b-914e-4725-8763-638c7bceffa8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.170794 Jul 21 20:55:15.102898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 158/332] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:14 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:15.581666 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-0925a835-0c16-474d-b7f1-16a1b24eedc6 req-83e7f027-f77a-4fc6-b18e-75e885d71d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdd0733-50ba-4256-ab59-8f480c117c13", "name": "network-vif-plugged", "status": "completed", "tag": "bef5d58c-c94f-4a10-9331-5b8e41b40151"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:15.602838 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-0925a835-0c16-474d-b7f1-16a1b24eedc6 req-83e7f027-f77a-4fc6-b18e-75e885d71d17 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:15.603609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-0925a835-0c16-474d-b7f1-16a1b24eedc6 req-83e7f027-f77a-4fc6-b18e-75e885d71d17 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:15.627313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-0925a835-0c16-474d-b7f1-16a1b24eedc6 req-83e7f027-f77a-4fc6-b18e-75e885d71d17 service nova] Creating event network-vif-plugged:bef5d58c-c94f-4a10-9331-5b8e41b40151 for instance 9fdd0733-50ba-4256-ab59-8f480c117c13 on hv-cinder-85068 Jul 21 20:55:15.636096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-0925a835-0c16-474d-b7f1-16a1b24eedc6 req-83e7f027-f77a-4fc6-b18e-75e885d71d17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058675 Jul 21 20:55:15.637022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 175/333] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:15.766006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:15.766684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:15.774035 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:15.774405 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:15.775022 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:15.775463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:15.848545 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:15.849317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:15.855882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:15.857800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:15.858296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:15.859056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:15.859542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:15.923890 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:15.932916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7df81ec0-088e-4cfd-be10-ec175f8d81cd tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.171461 Jul 21 20:55:15.933507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 159/334] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:15 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:16.005154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:16.013397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-13b06636-b014-414e-8a31-f1548f8f0474 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.169208 Jul 21 20:55:16.013970 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 176/335] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:15 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:16.122938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:16.123923 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:16.130692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:16.131269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:16.132076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:16.132521 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:16.284614 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:16.292494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-37171368-104d-48f6-9457-c6ac32ce02a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.176447 Jul 21 20:55:16.293080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 160/336] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:16 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:16.949964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:16.950553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:16.956611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:16.957059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:16.957820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:16.958255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:17.033995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:17.034906 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:17.041244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:17.041696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:17.042605 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:17.042946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:17.098370 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:17.111920 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a4cb8123-79bb-477e-a713-242d3ae9bf3b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.165293 Jul 21 20:55:17.112840 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 177/337] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:16 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:17.180848 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:17.188491 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b1ddd61b-75b9-4d37-97b5-83106d3ffd87 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.159015 Jul 21 20:55:17.189097 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 161/338] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:17 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:17.309602 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:17.310126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:17.316328 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:17.316777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:17.317548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:17.318075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:17.450312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:17.458240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bcf66034-d0b7-4ab5-abd1-7d98a9e53ee9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.152456 Jul 21 20:55:17.459691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 178/339] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:17 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:18.136299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:18.136916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:18.143442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:18.143928 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:18.144699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:18.145141 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:18.205680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:18.206304 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:18.213221 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:18.213766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:18.214570 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:18.215001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:18.290355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:18.297951 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3a2f56e6-aeb9-4eda-94ab-13942de1920d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.165502 Jul 21 20:55:18.298863 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 162/340] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:18 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:18.356952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:18.365311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d1ed4c68-bfa4-4614-9cbf-61dfacf8eb57 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.163053 Jul 21 20:55:18.365868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 179/341] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:18 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:18.476568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:18.477178 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:18.483340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:18.483824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:18.484613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:18.485054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:18.619295 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:18.627262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6412edf5-2de6-4c3a-bd10-8ab9d0d49d00 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.154463 Jul 21 20:55:18.627854 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 163/342] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:18 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:19.315691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:19.316313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:19.323051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:19.323491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:19.324296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:19.324733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:19.383096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:19.384358 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:19.390982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:19.391435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:19.392235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:19.392674 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:19.460049 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:19.467555 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a5e99953-3dd7-49db-9c23-2c6959ee6dc9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.155632 Jul 21 20:55:19.468151 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 180/343] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:19 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:19.532922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:19.541207 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0d2ede1d-a703-460a-8651-b3d5885e503f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.162766 Jul 21 20:55:19.541794 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 164/344] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:19 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:19.645385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:19.646002 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:19.652141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:19.652582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:19.653347 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:19.653781 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:19.793187 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:19.800743 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0a19eb26-32b7-4e7e-a419-75932a6e1c85 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.159338 Jul 21 20:55:19.801323 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 181/345] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:19 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:20.484833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:20.485476 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:20.492960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:20.493409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:20.494179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:20.494614 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:20.558614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:20.560240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:20.566882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:20.567671 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:20.569585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:20.570095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:20.647986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:20.651494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:20.656021 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9088ee24-c245-492f-9673-6a724e443648 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.175029 Jul 21 20:55:20.656611 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 165/346] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:20 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:20.712808 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:20.720427 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bfa4cd78-589d-4049-9e76-8f5c16309d11 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.165573 Jul 21 20:55:20.721001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 182/347] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:20 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:20.819246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:20.819792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:20.825996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:20.826447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:20.827274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:20.827738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:20.963225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:20.970616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b1d78681-af33-4444-8677-848d29929925 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.156423 Jul 21 20:55:20.971182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 166/348] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:20 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:21.674886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:21.675497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:21.681777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:21.682228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:21.682999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:21.683438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:21.738081 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:21.738741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:21.746772 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:21.747305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:21.748153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:21.748593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:21.819179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:21.826547 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5e3f69b9-08d1-44ef-abe5-5337ea5e1ac1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.155416 Jul 21 20:55:21.827110 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 183/349] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:21 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:21.883058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:21.890477 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c56dc12f-1aac-42f8-adab-6b988775c591 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.156540 Jul 21 20:55:21.891082 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 167/350] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:21 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:21.988585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:21.989193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:21.995754 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:21.996206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:21.996970 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:21.997403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:22.132777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:22.140325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e181ea89-0325-4a50-8b84-1e029db4a79b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.155723 Jul 21 20:55:22.140833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 184/351] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:21 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:22.845214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:22.845829 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:22.853045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:22.853492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:22.854255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:22.854694 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:22.907987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:22.908597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:22.915235 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:22.915681 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:22.916479 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:22.916916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:22.935195 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:22.987028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:22.994822 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1e00b1f9-a354-4f21-ae9b-515862ddd36d tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.153846 Jul 21 20:55:22.995510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 168/352] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:22 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:23.051265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:23.059356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-765a69f1-48e0-436b-9d8a-a11d175f65ff tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.155262 Jul 21 20:55:23.059953 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 185/353] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:22 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:23.157190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:23.157807 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:23.164978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:23.165429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:23.166209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:23.166650 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:23.296174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:23.304356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-730babb2-ae97-4ec3-8b71-69d7a9157d33 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.151022 Jul 21 20:55:23.304965 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 169/354] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:23 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:24.011301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:24.011940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:24.018096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:24.018543 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:24.019341 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:24.019807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:24.076150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:24.076819 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:24.084067 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:24.084836 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:24.085632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:24.086084 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:24.152504 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:24.160668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-974ba604-16a9-4da7-9684-f7775b2f98f3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.152965 Jul 21 20:55:24.161988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 186/355] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:24 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:24.234948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:24.243290 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c52481be-0ea6-480f-9c58-99712fcc7f5d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.171049 Jul 21 20:55:24.243926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 170/356] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:24 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:24.321783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:24.322467 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:24.328461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:24.328926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:24.329686 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:24.330117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:24.466900 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:24.474394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ab3ba0e5-bc1c-41a8-a3f2-80a4cd8fd22c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.157018 Jul 21 20:55:24.474973 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 187/357] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:24 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:25.179305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:25.179945 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:25.186845 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:25.187286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:25.188077 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:25.188513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:25.260550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:25.261157 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:25.267259 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:25.267745 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:25.268517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:25.268946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:25.332869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:25.341095 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f52b1b9a-e717-42a3-9d7e-0e3411c725c1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.165873 Jul 21 20:55:25.341828 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 171/358] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:25 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:25.416360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:25.424009 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3982de4c-9518-475a-9681-7b3987709e7f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.167230 Jul 21 20:55:25.424579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 188/359] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:25 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:25.492164 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:25.492810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:25.499110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:25.499566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:25.500388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:25.500834 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:25.636630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:25.644170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f81a1254-b92a-414d-bab9-165744ec66fd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.156500 Jul 21 20:55:25.644743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 172/360] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:25 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:26.358157 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:26.358778 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:26.365205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:26.365645 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:26.366402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:26.366828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:26.440608 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:26.441225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:26.448529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:26.448987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:26.449760 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:26.450205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:26.499219 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:26.507980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4643718e-af30-4552-832f-d114b5b93ba3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.153577 Jul 21 20:55:26.508654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 189/361] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:26 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:26.579767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:26.587280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c1ba3362-88ef-4337-8b72-c66180d3dc6c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.150499 Jul 21 20:55:26.587888 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 173/362] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:26 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:26.662369 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:26.662980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:26.669557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:26.670010 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:26.670787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:26.671326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:26.807959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:26.816061 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9fe18f9e-b748-41ed-84b2-d1e13a97cbfe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.157814 Jul 21 20:55:26.816643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 190/363] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:26 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:27.524534 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:27.525151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:27.532067 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:27.532520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:27.533314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:27.533752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:27.605627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:27.606315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:27.613536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:27.613984 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:27.615281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:27.615740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:27.683023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:27.690590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-910af993-43c1-422c-9b83-5a3f93b060fe tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.170016 Jul 21 20:55:27.691170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 174/364] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:27 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:27.759931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:27.767706 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6d088943-d8a2-4e1d-b9be-04cf234e3e47 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.166752 Jul 21 20:55:27.768309 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 191/365] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:27 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:27.832463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:27.833072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:27.839237 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:27.839685 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:27.840480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:27.840914 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:27.975244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:27.982708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-be0b0a16-6d2d-4f52-b3dc-264f60501abe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.154078 Jul 21 20:55:27.983274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 175/366] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:27 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:28.709105 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:28.709733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:28.715625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:28.716089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:28.716844 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:28.717272 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:28.785200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:28.785803 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:28.792720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:28.793161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:28.794122 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:28.794720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:28.931769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:28.939574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-26171e42-7095-4576-8b9e-5e36527dd68c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.158034 Jul 21 20:55:28.940202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 176/367] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:28 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:29.001315 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:29.002198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:29.009011 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:29.009702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:29.010558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:29.011068 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:29.068688 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:29.077545 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e11f6fd9-8a56-4d4d-ab73-e68bccb0f2b1 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.372885 Jul 21 20:55:29.078117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 192/368] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:28 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:29.156916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:29.166263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d8080d99-f45c-4eff-9bf0-149acd333f75 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.169331 Jul 21 20:55:29.166857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 177/369] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:28 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:29.956543 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:29.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:29.964316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:29.964767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:29.965541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:29.965975 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:30.095433 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:30.096134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:30.100856 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:30.103260 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:30.103740 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:30.104521 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:30.104964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:30.109193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-eb2b31e4-b671-46b4-9f53-1a2f699f31a2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.156430 Jul 21 20:55:30.109867 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 193/370] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:29 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:30.185037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:30.185656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:30.191742 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:30.192198 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:30.193789 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:30.194548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:30.247891 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:30.256114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fcd9735e-ac4a-4123-8d5c-95166d416289 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.164438 Jul 21 20:55:30.256920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 178/371] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:30 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:30.349769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:30.362846 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bd4e55bb-3fdf-4cad-89d3-305b90c0ef5c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.181603 Jul 21 20:55:30.364352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 194/372] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:30 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:31.140442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:31.149946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:31.165821 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:31.166305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:31.167098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:31.167547 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:31.274773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:31.276125 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:31.283325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:31.284000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:31.284841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:31.285487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:31.350061 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:31.358702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-01883c53-605b-449a-ba82-26e6679f3c9e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.234652 Jul 21 20:55:31.359292 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 179/373] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:31 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:31.382591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:31.383206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:31.389370 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:31.390031 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:31.390812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:31.391245 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:31.438241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:31.446729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1da79822-cd03-452d-8726-01a078ab90e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.177263 Jul 21 20:55:31.447576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 195/374] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:31 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:31.536021 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:31.544767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-05e16418-ed5a-48c0-acde-86ef1b4ab131 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.166659 Jul 21 20:55:31.547537 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 180/375] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:31 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:32.376060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:32.376676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:32.384978 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:32.385424 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:32.386207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:32.386640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:32.463668 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:32.464392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:32.481607 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:32.482227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:32.483151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:32.483651 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:32.532820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:32.545536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7ff98d1a-af1f-4288-be13-bdb321326c24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.173416 Jul 21 20:55:32.556740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 196/376] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:32 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:32.579923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:32.581947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:32.596725 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:32.599996 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:32.600908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:32.601351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:32.647387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:32.655696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-26e2615b-8f89-4d2b-86dc-5fe066d22c58 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.195875 Jul 21 20:55:32.656372 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 181/377] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:32 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:32.785415 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:32.795234 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-efe89e62-3c08-41d7-83b3-f825e60f14b4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.225042 Jul 21 20:55:32.795835 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 197/378] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:32 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:33.563793 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:33.564393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:33.570933 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:33.571386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:33.572187 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:33.572633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:33.590800 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:33.673450 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:33.674087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:33.680611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:33.681068 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:33.681969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:33.682413 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:33.709385 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:33.717147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a511bb77-11f6-4228-9368-7d30476a1f3b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.157309 Jul 21 20:55:33.717739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 182/379] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:33 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:33.817871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:33.818487 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:33.826167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:33.826677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:33.827395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:33.828344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:33.830160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:33.840181 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-01b07f93-a0cd-432a-833b-b9cebba91a63 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1314 microversion: 2.1 time: 0.170184 Jul 21 20:55:33.840764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 198/380] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:33 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:33.998908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:34.007074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-50b65e3b-e571-4128-85ed-bf18fa9e8b26 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.193230 Jul 21 20:55:34.007662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 183/381] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:33 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:34.237449 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-3d17abd4-9ff2-4d04-9b7a-3eed49bf08a0 req-f78307f6-419f-450b-8aca-c434262e21f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a0918b-9ae2-48d6-943a-bff67b0e7ca6", "name": "network-vif-plugged", "status": "completed", "tag": "3d26f1bb-0cc8-4534-94aa-7d6db164e0dd"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:34.249165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3d17abd4-9ff2-4d04-9b7a-3eed49bf08a0 req-f78307f6-419f-450b-8aca-c434262e21f1 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:34.249575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3d17abd4-9ff2-4d04-9b7a-3eed49bf08a0 req-f78307f6-419f-450b-8aca-c434262e21f1 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:34.264933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-3d17abd4-9ff2-4d04-9b7a-3eed49bf08a0 req-f78307f6-419f-450b-8aca-c434262e21f1 service nova] Creating event network-vif-plugged:3d26f1bb-0cc8-4534-94aa-7d6db164e0dd for instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 on hv-cinder-85068 Jul 21 20:55:34.270309 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-3d17abd4-9ff2-4d04-9b7a-3eed49bf08a0 req-f78307f6-419f-450b-8aca-c434262e21f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036816 Jul 21 20:55:34.271581 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 199/382] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:34.735408 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:34.736428 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:34.744278 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:34.744777 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:34.745572 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:34.746015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:34.858172 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:34.859142 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:34.869113 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:34.870460 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:34.871355 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:34.871902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:34.916194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:34.925088 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-43bb0d7c-f9b2-4f3b-a2aa-7222d61e07be tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.193366 Jul 21 20:55:34.925662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 184/383] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:34 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:35.026404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:35.027284 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:35.035660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.037238 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:35.039871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.040797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:35.062478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:35.074147 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c9698d8a-e992-4839-9569-d62a329c1651 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1463 microversion: 2.1 time: 0.219928 Jul 21 20:55:35.088087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 200/384] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:34 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1463 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:35.144123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:35.144680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:35.153334 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.153782 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:35.154570 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.155008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:35.237996 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:55:35.319314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:35.322035 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:35.348017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-00732b9b-e1bb-4d85-8ef3-07b26ad321de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.327813 Jul 21 20:55:35.361696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 185/385] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:35 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:35.399625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bdd62f7a-d6a4-4ec8-bc36-cc76ccf128c3 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 204 len: 0 microversion: 2.1 time: 0.259576 Jul 21 20:55:35.400208 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 201/386] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 20:55:35 2022] DELETE /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 20:55:35.412082 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:35.412768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:35.419277 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.420073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:35.421089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.423320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:35.570660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:35.581796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-85fc6ea0-1334-43f1-b90b-2ca57affc3e6 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.174564 Jul 21 20:55:35.584098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 186/387] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:35 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:35.943625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:35.944345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:35.950372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.950822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:35.951590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:35.952098 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:36.090962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:36.098610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7ffb89b5-9094-4954-a0d8-8b5442a9c1f2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.159698 Jul 21 20:55:36.099185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 202/388] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:35 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:36.371895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:36.372531 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:36.379047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:36.379492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:36.380945 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:36.381382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:36.528943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:36.536727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c8e6f495-2f7f-4bc6-b080-1856c0d66f68 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.168766 Jul 21 20:55:36.537355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 187/389] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:36 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:36.606038 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:36.606657 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:36.612953 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:36.613405 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:36.614177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:36.614617 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:36.753048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:36.761122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-48d0788d-5407-4ad8-ad7a-b206f8b0d453 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.158840 Jul 21 20:55:36.761710 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 203/390] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:36 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:37.117330 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:37.118038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:37.125961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:37.126414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:37.127189 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:37.127624 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:37.267701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:37.277615 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bfa75cae-5d33-4264-9aef-4282175f7a6a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.165220 Jul 21 20:55:37.287142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 188/391] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:37 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:37.554045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:37.554825 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:37.560764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:37.561214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:37.561988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:37.562425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:37.726239 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:37.733889 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bd28f28b-7b64-4e45-8ac7-4ccd8e8e1c7c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.183923 Jul 21 20:55:37.734499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 204/392] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:37 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:37.778473 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:37.779169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:37.781655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=80 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:37.787863 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:37.788596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:37.789575 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:37.790020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:37.924585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:37.932370 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c25f0736-ce70-4449-b03a-2cc427be8d04 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.157865 Jul 21 20:55:37.932950 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 189/393] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:37 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:38.294662 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:38.295272 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:38.301435 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:38.301884 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:38.302780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:38.303493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:38.442059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:38.449939 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f6a43dca-3701-4c83-ad11-18b83cdaf893 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.159009 Jul 21 20:55:38.450417 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 205/394] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:38 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:38.752294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:38.752999 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:38.759558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:38.760156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:38.760945 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:38.761384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:38.934996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:38.947612 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9c30dfa8-8af6-4294-826b-1c407b796783 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.199629 Jul 21 20:55:38.948614 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 190/395] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:38 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:38.952746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:38.954619 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:38.964845 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:38.966824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:38.967673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:38.971966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:39.117955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:39.126308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-79677475-b3d5-4429-bc19-8af37dda2f07 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.179972 Jul 21 20:55:39.128230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 206/396] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:38 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:39.467432 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:39.468070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:39.474414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:39.475468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:39.476411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:39.476952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:39.618838 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:39.626562 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b58d17d6-290c-4db6-b8cd-cdeca485a598 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.162874 Jul 21 20:55:39.627468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 191/397] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:39 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:39.965565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:39.966174 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:39.972312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:39.972835 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:39.973522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:39.973949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:40.116026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:40.128414 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-50d3d620-214c-4f50-8778-3737e521ffec tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.166053 Jul 21 20:55:40.129770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 207/398] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:39 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:40.146110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:40.147420 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:40.154849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:40.155310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:40.156146 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:40.156596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:40.388491 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:40.397816 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c958645f-170b-4155-bfd0-6df2f062c531 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.256821 Jul 21 20:55:40.398696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 192/399] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:40 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:40.645918 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:40.646528 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:40.652917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:40.653360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:40.654126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:40.655191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:40.883066 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:40.890871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f71ca7ca-80ac-4391-93e6-69b6dec647b7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.248671 Jul 21 20:55:40.891440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 208/400] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:40 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:41.146684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:41.147331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:41.153911 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:41.154371 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:41.155181 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:41.155628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:41.311972 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:41.320760 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1beeaa6d-5ec4-4e19-bd9f-db86836a9807 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.178128 Jul 21 20:55:41.321537 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 193/401] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:41 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:41.416313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:41.418038 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:41.424919 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:41.425374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:41.426165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:41.426604 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:41.566210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:41.574432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7f650634-d71b-461c-aa29-d26b6413cc36 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.162565 Jul 21 20:55:41.575056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 209/402] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:41 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:41.908467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:41.909085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:41.915391 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:41.915874 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:41.916661 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:41.917101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:42.053590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:42.061116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0d168faa-b8ce-44b5-8074-53e3703038e9 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.156694 Jul 21 20:55:42.061696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 194/403] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:41 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:42.338852 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:42.339473 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:42.345837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:42.346279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:42.347051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:42.347483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:42.495942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:42.505503 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7ac66022-5575-4797-b134-e92c1b1f8111 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.170507 Jul 21 20:55:42.506113 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 210/404] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:42 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:42.592284 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:42.592897 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:42.600300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:42.600751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:42.601528 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:42.601992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:42.744702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:42.752330 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ab6c40d1-ebeb-44b5-85df-4e0de22b11e9 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.163898 Jul 21 20:55:42.752903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 195/405] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:42 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:43.078541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:43.079206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:43.085652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:43.086096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:43.086876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:43.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:43.225195 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:43.232917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d32fda4a-565e-4808-89fb-cf2bf76748f1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.158224 Jul 21 20:55:43.233505 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 211/406] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:43 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:43.523096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:43.523691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:43.530012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:43.530655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:43.531245 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:43.531684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:43.673805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:43.682079 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f7888ce1-821f-4011-84c0-474723edecb4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.163609 Jul 21 20:55:43.682654 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 196/407] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:43 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:43.769771 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:43.770460 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:43.777441 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:43.777884 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:43.778650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:43.779084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:43.912749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:43.920721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-efa8ac87-c5b1-4a2d-95b5-257e8c363950 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.155091 Jul 21 20:55:43.921353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 212/408] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:43 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:44.251185 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:44.251742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:44.258312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:44.258756 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:44.259513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:44.259984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:44.393523 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:44.402003 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f2ed79bd-bb19-44b4-a343-ee8ccb95a8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.154949 Jul 21 20:55:44.402605 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 197/409] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:44 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:44.698948 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:44.699557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:44.705589 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:44.706039 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:44.706805 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:44.707312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:44.836852 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:44.844134 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1f3fb403-af49-46fc-8a8b-3f8c2b0c6240 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.148990 Jul 21 20:55:44.844690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 213/410] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:44 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:44.938015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:44.938634 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:44.945812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:44.946271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:44.947040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:44.947481 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:45.082682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:45.092272 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9cf97d45-22b7-411a-9b29-f828ffabb29a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.158065 Jul 21 20:55:45.092779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 198/411] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:44 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:45.419864 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:45.420481 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:45.426682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:45.427135 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:45.427937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:45.428458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:45.560830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:45.568225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-51f878aa-b8c3-44f5-a519-0380c666fc84 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.152560 Jul 21 20:55:45.569386 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 214/412] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:45 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:45.861889 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:45.862501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:45.868547 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:45.868987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:45.869736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:45.870164 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:45.874080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:45.997536 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:46.005056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6e7dd727-3101-43db-9ffa-854272782ab2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.147223 Jul 21 20:55:46.005630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 199/413] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:45 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:46.109620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:46.110225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:46.112472 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:46.118112 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:46.118545 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:46.119297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:46.119826 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:46.253500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:46.261789 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d2e9d81e-ff41-415c-a4df-65695b0a464b tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.156020 Jul 21 20:55:46.262343 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 215/414] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:46 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:46.586297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:46.586907 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:46.592941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:46.593395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:46.594164 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:46.594607 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:46.730273 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:46.738098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4fe9ee14-f44e-4764-8942-f4fb1922835f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.156328 Jul 21 20:55:46.738676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 200/415] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:46 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:47.023139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:47.023676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:47.029699 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:47.030140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:47.030899 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:47.031329 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:47.162107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:47.169936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8afe43d7-a157-4d96-8ac0-b5acc8c3dee7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.151578 Jul 21 20:55:47.170510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 216/416] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:47 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:47.279046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:47.279587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:47.286068 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:47.286522 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:47.287281 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:47.287744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:47.638190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:47.645613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ae4817c5-4fda-43ae-ab7e-fba9700ece38 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.370524 Jul 21 20:55:47.646191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 201/417] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:47 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:47.755476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:47.756281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:47.762989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:47.763439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:47.764230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:47.764660 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:47.902686 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:47.906107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:55:47.910841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-76ae9075-bdd8-49df-811b-74dcd6a98b3c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.159418 Jul 21 20:55:47.911413 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 217/418] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:47 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:48.186341 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:48.186959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:48.192998 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:48.193459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:48.194854 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:48.195295 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:48.323665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:48.331084 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-656316d8-0300-4877-af5b-55d784200500 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.148602 Jul 21 20:55:48.331645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 202/419] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:48 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:48.662803 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:48.663381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:48.670570 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:48.671021 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:48.671833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:48.672277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:48.800712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:48.808895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1f5f81c0-2c01-4008-94c6-ba55dae8cd60 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1469 microversion: 2.1 time: 0.150173 Jul 21 20:55:48.809472 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 218/420] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:48 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:48.926929 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:48.927456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:48.934017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:48.934464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:48.935216 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:48.935648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:49.064127 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:49.072361 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3b12e6ec-326d-40ac-807e-9bc1a1ba9cc5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.149416 Jul 21 20:55:49.072936 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 203/421] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:48 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:49.348370 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:49.348970 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:49.354967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:49.355414 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:49.356191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:49.356623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:49.581766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:49.592408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-90c0bcb1-23e5-4ba8-b2af-12f37e0ed142 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1364 microversion: 2.1 time: 0.247743 Jul 21 20:55:49.602191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 219/422] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:49 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:49.737102 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-54758028-b463-4aa0-b544-44d23680f097 req-5de7daf3-bc34-448b-8445-7959c0bbefdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdd0733-50ba-4256-ab59-8f480c117c13", "name": "network-vif-unplugged", "status": "completed", "tag": "bef5d58c-c94f-4a10-9331-5b8e41b40151"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:49.748044 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-54758028-b463-4aa0-b544-44d23680f097 req-5de7daf3-bc34-448b-8445-7959c0bbefdc service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:49.748773 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-54758028-b463-4aa0-b544-44d23680f097 req-5de7daf3-bc34-448b-8445-7959c0bbefdc service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:49.762967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-54758028-b463-4aa0-b544-44d23680f097 req-5de7daf3-bc34-448b-8445-7959c0bbefdc service nova] Creating event network-vif-unplugged:bef5d58c-c94f-4a10-9331-5b8e41b40151 for instance 9fdd0733-50ba-4256-ab59-8f480c117c13 on hv-cinder-85068 Jul 21 20:55:49.768421 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-54758028-b463-4aa0-b544-44d23680f097 req-5de7daf3-bc34-448b-8445-7959c0bbefdc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035614 Jul 21 20:55:49.769190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 204/423] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:49.827463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:49.828117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:49.856504 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:49.857074 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:49.858117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:49.858556 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:49.978461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:49.987647 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a02ea8f7-ad96-4ef3-98c5-69c7d6d31a1a tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1427 microversion: 2.1 time: 0.165266 Jul 21 20:55:49.988676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 220/424] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:49 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1427 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:50.017561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-38227d6c-e76b-4c5f-b3b3-32a62f206d4c req-cf86e9ea-3e56-4de4-a5b0-9aea5af74e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdd0733-50ba-4256-ab59-8f480c117c13", "name": "network-vif-deleted", "tag": "bef5d58c-c94f-4a10-9331-5b8e41b40151"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:50.019476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-210914986", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "networks": [{"uuid": "133dba56-f9b1-4b52-b38c-7b3ffc5be897"}]}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:50.029000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-38227d6c-e76b-4c5f-b3b3-32a62f206d4c req-cf86e9ea-3e56-4de4-a5b0-9aea5af74e5b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.029440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-38227d6c-e76b-4c5f-b3b3-32a62f206d4c req-cf86e9ea-3e56-4de4-a5b0-9aea5af74e5b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.042531 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-38227d6c-e76b-4c5f-b3b3-32a62f206d4c req-cf86e9ea-3e56-4de4-a5b0-9aea5af74e5b service nova] Creating event network-vif-deleted:bef5d58c-c94f-4a10-9331-5b8e41b40151 for instance 9fdd0733-50ba-4256-ab59-8f480c117c13 on hv-cinder-85068 Jul 21 20:55:50.047630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-38227d6c-e76b-4c5f-b3b3-32a62f206d4c req-cf86e9ea-3e56-4de4-a5b0-9aea5af74e5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034066 Jul 21 20:55:50.048510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 205/425] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:50.074888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] validate_networks() for [('133dba56-f9b1-4b52-b38c-7b3ffc5be897', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:55:50.089938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:50.090636 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:50.097997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.098442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.099225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.099660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.260278 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:50.271353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-51679ab3-2514-4935-bbf5-104b87fbbd18 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.185539 Jul 21 20:55:50.273290 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 206/426] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:50 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:50.549500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:55:50.550052 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:55:50.550532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:55:50.550942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:55:50.551361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:55:50.561003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.561003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.561996 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.562754 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.582984 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Getting quotas for project 98e1d76644d94fd9ada9ff1ae3267bf8. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:55:50.589459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Getting quotas for user cc44212b992e4358bb37a1f8c4a6a77c and project 98e1d76644d94fd9ada9ff1ae3267bf8. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:55:50.605838 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:55:50.607477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:55:50.609478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:50.610253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:50.618881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.620188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.621032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.621809 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.668569 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f81f7b45-92c7-42de-8aef-224f4bab63b0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653529 Jul 21 20:55:50.669213 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 221/427] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:55:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 20:55:50.681819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-590db8d3-62e9-4410-8640-8ee926960005 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:50.683429 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-590db8d3-62e9-4410-8640-8ee926960005 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:50.750534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-590db8d3-62e9-4410-8640-8ee926960005 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:50.760797 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-590db8d3-62e9-4410-8640-8ee926960005 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1218 microversion: 2.1 time: 0.084178 Jul 21 20:55:50.761385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 222/428] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:50 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:50.778807 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:50.794496 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-05e0edda-db09-470c-bd67-89ea98f89e35 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1549 microversion: 2.1 time: 0.187030 Jul 21 20:55:50.795195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 207/429] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:50 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:50.814801 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d1db22d2-5303-4c79-8886-c95e7056f0d9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:50.815330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d1db22d2-5303-4c79-8886-c95e7056f0d9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:50.823692 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1db22d2-5303-4c79-8886-c95e7056f0d9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.824334 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1db22d2-5303-4c79-8886-c95e7056f0d9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.825248 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1db22d2-5303-4c79-8886-c95e7056f0d9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:50.825688 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d1db22d2-5303-4c79-8886-c95e7056f0d9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:50.942010 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d1db22d2-5303-4c79-8886-c95e7056f0d9 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130006 Jul 21 20:55:50.950818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 223/430] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 20:55:50 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:51.007834 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:51.008501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:51.014921 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:51.015372 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:51.016196 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:51.016846 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:51.123383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:51.136345 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9a1a4a5d-9361-4917-9e90-a22a3ac77c62 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1299 microversion: 2.1 time: 0.133056 Jul 21 20:55:51.136853 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 208/431] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:51 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:51.290395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:51.290996 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:51.296974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:51.297414 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:51.298204 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:51.298634 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:51.432048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:51.439877 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-93b626e9-0e3a-414a-b92e-ced696a0dfb3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.153525 Jul 21 20:55:51.440497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 224/432] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:51 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:51.778688 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:51.779306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:51.785863 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:51.786310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:51.787077 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:51.787775 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:51.875978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:51.884304 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9359fbe6-5fd1-4aaf-ac65-2143db2df657 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1222 microversion: 2.1 time: 0.109390 Jul 21 20:55:51.884991 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 209/433] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:51 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:52.156969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:52.157834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:52.166522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.167144 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.168382 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.168845 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.202255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.202897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.203502 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lazy-loading 'fault' on Instance uuid 9fdd0733-50ba-4256-ab59-8f480c117c13 {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:55:52.271033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6e45e0cb81448baaae7d4f2ccd5d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f56ad01c544c958f8e65367ff5c575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:52.274792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-39040fbd-776e-4d85-a1d4-c317dd89cb77 req-6ebc353d-26bd-4b15-8ff3-aa949b2723ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a0918b-9ae2-48d6-943a-bff67b0e7ca6", "tag": "3d26f1bb-0cc8-4534-94aa-7d6db164e0dd"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:52.294145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-30e735b8-ce36-4275-aaf6-1108e76ed71f tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 200 len: 1304 microversion: 2.1 time: 0.141357 Jul 21 20:55:52.295478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 225/434] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:52 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:52.302310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-39040fbd-776e-4d85-a1d4-c317dd89cb77 req-6ebc353d-26bd-4b15-8ff3-aa949b2723ea service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.303053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-39040fbd-776e-4d85-a1d4-c317dd89cb77 req-6ebc353d-26bd-4b15-8ff3-aa949b2723ea service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.315334 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-39040fbd-776e-4d85-a1d4-c317dd89cb77 req-6ebc353d-26bd-4b15-8ff3-aa949b2723ea service nova] Creating event network-changed:3d26f1bb-0cc8-4534-94aa-7d6db164e0dd for instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 on hv-cinder-85068 Jul 21 20:55:52.322058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-39040fbd-776e-4d85-a1d4-c317dd89cb77 req-6ebc353d-26bd-4b15-8ff3-aa949b2723ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054602 Jul 21 20:55:52.323109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 210/435] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:52.457850 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:52.458463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:52.468192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.469627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.469627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.470003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.626382 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:52.636335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2958febf-726e-41b9-b60a-94bf01c66b24 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1503 microversion: 2.1 time: 0.182296 Jul 21 20:55:52.639976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 226/436] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:52 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:52.654842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "380a362a-857e-4d6f-afbb-e5ddeb70a8c8"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:52.656140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:52.664705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.665350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.666147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.666859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.693922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] HTTP exception thrown: Cannot 'attach_volume' instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd while it is in vm_state rescued Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Request method failure captured: Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: POST /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd/os-volume_attachments HTTP/1.1 Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 74 Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2byallxj-2zIOzbBTUsZ6s8zHDXiJcycfCm-0RzgZz8_G4ZMyQWr6DfdbRbtxCoixJ3bYreLJTWtQGm0RkxmhjqM0kKNO_2gNp_qaUH1qrUrvKQXuW63hJjKZSd_dyfntXJFzmOogi8eUrIpcMTbgiydWoSb1Njj36DS5PWyvRHgrus Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 20:55:52.696818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 24e4efb87cd34008a1b83c0ea0cce5aa Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {"volumeAttachment": {"volumeId": "380a362a-857e-4d6f-afbb-e5ddeb70a8c8"}} Jul 21 20:55:52.698389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Cannot 'attach_volume' instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd while it is in vm_state rescued Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'server_id': '4ddeb6ba-597a-4d70-b8ce-8a803668cbdd', 'body': {'volumeAttachment': {'volumeId': '380a362a-857e-4d6f-afbb-e5ddeb70a8c8'}}} Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:55:52.699279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd while it is in vm_state rescued Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:55:52.700532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:55:52.701631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:55:52.701631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:55:52.701631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd while it is in vm_state rescued Jul 21 20:55:52.701631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:52.701631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Returning 409 to user: Cannot 'attach_volume' instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd while it is in vm_state rescued {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:55:52.701631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c741e2a9-2447-4c0f-97f7-49d1e9f5b8bb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048066 Jul 21 20:55:52.701631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 211/437] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 20:55:52 2022] POST /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 20:55:52.708769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-166dd763-7dec-4629-87f0-7e966abdd73e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:52.709866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-166dd763-7dec-4629-87f0-7e966abdd73e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:52.716596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-166dd763-7dec-4629-87f0-7e966abdd73e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.717088 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-166dd763-7dec-4629-87f0-7e966abdd73e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.717889 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-166dd763-7dec-4629-87f0-7e966abdd73e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.718342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-166dd763-7dec-4629-87f0-7e966abdd73e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.831434 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-166dd763-7dec-4629-87f0-7e966abdd73e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd/action" status: 202 len: 0 microversion: 2.1 time: 0.126467 Jul 21 20:55:52.832120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 227/438] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 20:55:52 2022] POST /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:55:52.840874 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:52.841484 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:52.848114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.848569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.849328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.850454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.906028 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:52.907187 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:52.939160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.940115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:52.941128 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:52.941846 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:53.064992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:53.067297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:53.074382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2e54a7f1-f393-4eb0-87f8-1fc59ca63e70 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1511 microversion: 2.1 time: 0.237333 Jul 21 20:55:53.075284 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 212/439] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:52 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:53.089158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f8d9ff03-9f64-4d92-bcb7-298ca8980a6f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1214 microversion: 2.1 time: 0.188656 Jul 21 20:55:53.089926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 228/440] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:52 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:53.312781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:53.313403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] [instance: 9fdd0733-50ba-4256-ab59-8f480c117c13] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:53.320499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:53.321140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:53.321944 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:53.322387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:53.339123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] HTTP exception thrown: Instance 9fdd0733-50ba-4256-ab59-8f480c117c13 could not be found. Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Request method failure captured: Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 HTTP/1.1 Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b0WDf42CW-xvNARL0Vy5Q5U4eHPEXk6jyAjmSlAZeCUhhpnCj13ftjdkDkDBa3ee9iQgLtUb3ciioiFfgN2eW17ksQkDSt3fQ6RuJfpHguhFKk0P7vWKZ_9izc88_u1DjDVUqZDwq9f44BpYl0hV7DmGadKd16_CXp5_1k72bXR3FE Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: a0f56ad01c544c958f8e65367ff5c575 Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-VolumesNegativeTest-1439955157 Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 20:55:53.340943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0f56ad01c544c958f8e65367ff5c575"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0f56ad01c544c958f8e65367ff5c575"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0f56ad01c544c958f8e65367ff5c575"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0f56ad01c544c958f8e65367ff5c575"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-VolumesNegativeTest-1439955157 Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: a0f56ad01c544c958f8e65367ff5c575 Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-VolumesNegativeTest-1439955157 Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-VolumesNegativeTest-1439955157-project Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5c6e45e0cb81448baaae7d4f2ccd5d28 Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-VolumesNegativeTest-1439955157-project Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 9fdd0733-50ba-4256-ab59-8f480c117c13 could not be found. Jul 21 20:55:53.342587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '9fdd0733-50ba-4256-ab59-8f480c117c13'} Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fdd0733-50ba-4256-ab59-8f480c117c13 could not be found. Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:55:53.344005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fdd0733-50ba-4256-ab59-8f480c117c13 could not be found. Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fdd0733-50ba-4256-ab59-8f480c117c13 could not be found. Jul 21 20:55:53.345413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:55:53.348698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] Returning 404 to user: Instance 9fdd0733-50ba-4256-ab59-8f480c117c13 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:55:53.348698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-95f92a0e-0533-41e0-ab73-e7b230097d87 tempest-VolumesNegativeTest-1439955157 tempest-VolumesNegativeTest-1439955157-project] 10.222.0.60 "GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13" status: 404 len: 111 microversion: 2.1 time: 0.035564 Jul 21 20:55:53.348698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 213/441] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:53 2022] GET /compute/v2.1/servers/9fdd0733-50ba-4256-ab59-8f480c117c13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:55:54.094491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:54.099058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:54.110443 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:54.111534 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:54.136287 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:54.137624 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:54.138527 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:54.141540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:54.142473 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:54.142976 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:54.146363 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:54.147036 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:54.241235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:54.250758 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cd1b14cd-fb54-4d69-a827-4f74fa267edc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1276 microversion: 2.1 time: 0.144198 Jul 21 20:55:54.252200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 214/442] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:54 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:54.534166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:54.543965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1e089819-bc44-4ed3-80ce-01824dafa11f tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1511 microversion: 2.1 time: 0.453627 Jul 21 20:55:54.544727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 229/443] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:54 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:55.273456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:55.275089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:55.283534 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:55.284340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:55.285402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:55.286073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:55.461588 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:55.468963 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-26a51c26-bfc6-40eb-be48-212cd4b3ca75 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.202054 Jul 21 20:55:55.469777 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 215/444] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:55 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:55.566597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:55.567385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:55.579113 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:55.579596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:55.580474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:55.580837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:55.807154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:55.819154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fc8b1833-99b9-49fd-a493-c0b791470a7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1511 microversion: 2.1 time: 0.260830 Jul 21 20:55:55.820205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 230/445] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:55 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:56.486063 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:56.486946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:56.493751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:56.494198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:56.494970 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:56.495404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:56.677300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:56.687581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-73cd6fef-c16b-43e3-a5b1-c7f680182a06 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.205014 Jul 21 20:55:56.688839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 216/446] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:56 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:56.841049 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:56.843019 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:56.855673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:56.857276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:56.858821 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:56.859465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:57.146002 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:57.155155 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ce6c21b5-a085-483c-b72f-532df12cf15e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1511 microversion: 2.1 time: 0.320969 Jul 21 20:55:57.155739 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 231/447] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:56 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:57.670608 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-74d2126c-6cc6-485d-a474-7c0013262907 req-41f2f9e7-e716-4fa1-ad44-8904107cf550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b193b823-d7ce-4e16-9404-d2c5984dfa9c", "tag": "91c59827-c0f0-43a1-a399-6c68970a550b"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:55:57.691013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-74d2126c-6cc6-485d-a474-7c0013262907 req-41f2f9e7-e716-4fa1-ad44-8904107cf550 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:57.691668 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-74d2126c-6cc6-485d-a474-7c0013262907 req-41f2f9e7-e716-4fa1-ad44-8904107cf550 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:57.704539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:57.705234 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:57.712952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:57.713459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:57.714348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:57.714911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:57.720625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-74d2126c-6cc6-485d-a474-7c0013262907 req-41f2f9e7-e716-4fa1-ad44-8904107cf550 service nova] Creating event network-changed:91c59827-c0f0-43a1-a399-6c68970a550b for instance b193b823-d7ce-4e16-9404-d2c5984dfa9c on hv-cinder-85068 Jul 21 20:55:57.726424 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-74d2126c-6cc6-485d-a474-7c0013262907 req-41f2f9e7-e716-4fa1-ad44-8904107cf550 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064888 Jul 21 20:55:57.739384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 217/448] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:55:57.957285 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:57.970736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-949d39cf-ff06-4932-ae0b-7704e5f2fbc3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.269869 Jul 21 20:55:57.971424 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 232/449] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:57 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:55:58.174905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:58.175745 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:58.182311 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:58.182832 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:58.183684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:58.184308 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:58.545906 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:58.554013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-46d65dc5-8301-421a-ba7f-2500153ae8e8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1517 microversion: 2.1 time: 0.383391 Jul 21 20:55:58.554574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 218/450] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:58 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1517 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:55:58.988303 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:55:58.989500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:55:58.996015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:58.996468 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:58.997242 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:55:58.997679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:55:59.127476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:55:59.135485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-76722d0d-ea66-4224-b655-2c7f3b0c325a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.151239 Jul 21 20:55:59.136084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 233/451] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:55:58 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:00.153191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:00.153836 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:00.160937 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:00.161396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:00.162375 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:00.162826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:00.183344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:00.294362 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:00.301789 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5e9e3841-1c06-4351-8359-20812ab83d4c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.152512 Jul 21 20:56:00.302349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 219/452] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:00 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:01.318264 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:01.318881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:01.321452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:01.322161 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=8 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:01.327824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:01.328271 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:01.329033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:01.329469 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:01.459607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:01.467495 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c9d4b76f-ca1b-47f3-a739-7af6cb9ef579 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.153138 Jul 21 20:56:01.468101 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 234/453] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:01 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:02.484806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:02.485412 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:02.492801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:02.493237 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:02.493984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:02.494414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:02.626465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:02.634073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a46679a7-d87b-4d74-9593-b625b691f29d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.153340 Jul 21 20:56:02.634931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 220/454] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:02 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:03.653837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:03.654448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:03.660503 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:03.660956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:03.661725 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:03.662165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:03.666160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:03.796098 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:03.803604 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-26e93126-f5bc-40ad-b71a-d81ee1f1662a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.154481 Jul 21 20:56:03.804179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 235/455] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:03 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:04.820767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:04.821518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:04.828338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:04.828786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:04.829543 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:04.829978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:04.968850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:04.976865 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b3cc2fdf-4752-42c2-9a52-3e955a3a53d7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.160231 Jul 21 20:56:04.977435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 221/456] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:04 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:05.146932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-df76cb33-69cd-42c6-b57d-54f0c7b55c9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'create', calling method: .version_select at 0x7f3540335430>, body: {"keypair": {"name": "tempest-keypair-2102084582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1UsJiZskzx4oxE5XMEa3hjsxEbgwtPQEKcDa9yDIpd8dccuvxf8he4sEnvw2vOEEtxUBbHlVZlCAfb60W96pJs8RCI4G5szymwt27zFDvf0+YROdsPPQkGlm+b9uMlmQ=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:05.161142 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-df76cb33-69cd-42c6-b57d-54f0c7b55c9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for project d9e9d8f8b55c4ef586252456ea195266. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:56:05.165040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-df76cb33-69cd-42c6-b57d-54f0c7b55c9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for user 24e4efb87cd34008a1b83c0ea0cce5aa and project d9e9d8f8b55c4ef586252456ea195266. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:56:05.187482 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-df76cb33-69cd-42c6-b57d-54f0c7b55c9b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044474 Jul 21 20:56:05.188135 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 236/457] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 20:56:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:56:05.994756 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:05.996004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:06.002885 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:06.003638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:06.005117 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:06.005720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:06.247368 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:06.255173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b6356a05-990e-40ff-8434-10c98c129396 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.264955 Jul 21 20:56:06.256035 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 222/458] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:05 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:06.664635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-966921385", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12e272e6-6c0f-4346-988b-fccdfdf62793"}], "security_groups": [{"name": "tempest-securitygroup--1782456780"}], "key_name": "tempest-keypair-2102084582", "user_data": "}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:06.775752 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] validate_networks() for [('12e272e6-6c0f-4346-988b-fccdfdf62793', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:56:07.165690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:56:07.166183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:56:07.166798 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:56:07.167218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:56:07.167642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:56:07.178078 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:07.178556 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:07.179479 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:07.179950 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:07.206005 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for project d9e9d8f8b55c4ef586252456ea195266. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:56:07.211947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Getting quotas for user 24e4efb87cd34008a1b83c0ea0cce5aa and project d9e9d8f8b55c4ef586252456ea195266. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:56:07.223774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:56:07.226713 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:56:07.272709 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:07.275360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:07.276391 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3c13a509-b0d9-4d08-ac25-2b73938e7983 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.616203 Jul 21 20:56:07.277120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 237/459] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:56:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:56:07.287133 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1a3b0dcc-6757-4037-8efe-273f8e641726 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:07.290201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1a3b0dcc-6757-4037-8efe-273f8e641726 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:07.294324 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:07.295047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:07.300255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:07.301130 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:07.359799 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1a3b0dcc-6757-4037-8efe-273f8e641726 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:07.368161 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1a3b0dcc-6757-4037-8efe-273f8e641726 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1245 microversion: 2.1 time: 0.084896 Jul 21 20:56:07.368812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 238/460] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:07 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:07.480199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:07.488475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d40acbc8-ef0e-48ed-bae4-13f30ae74fd5 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.220901 Jul 21 20:56:07.489079 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 223/461] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:07 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:56:08.386703 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:08.387945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:08.394726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:08.395431 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:08.396255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:08.396843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:08.507895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:08.509476 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:08.513015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=70 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:08.519296 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:08.519938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:08.520915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:08.521872 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:08.522621 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:08.532348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-66c6ad94-c7b8-4dfd-87c2-db1d08416c1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1249 microversion: 2.1 time: 0.149665 Jul 21 20:56:08.533442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 239/462] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:08 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1249 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:08.671781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:08.679349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-57c311bf-87bd-4a8e-90a0-cfec04dffddf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.176283 Jul 21 20:56:08.691959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 224/463] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:08 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:09.550747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:09.552156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:09.559993 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:09.560731 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:09.561828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:09.562406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:09.641786 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:09.651668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-aa8fb527-80ec-47e5-9b46-111b5c5a3827 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1249 microversion: 2.1 time: 0.104802 Jul 21 20:56:09.653185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 240/464] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:09 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1249 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:09.700700 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:09.702327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:09.709014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:09.710745 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:09.711625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:09.712788 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:09.953531 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:09.962445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5335242e-3d08-482a-8429-866fdf122d0e tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.265642 Jul 21 20:56:09.963270 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 225/465] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:09 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:56:10.670337 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:10.671670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:10.687280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:10.688205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:10.689091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:10.689627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:10.770149 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:10.789171 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-02c95b7e-dab8-4141-90be-eceb4374ee49 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1297 microversion: 2.1 time: 0.124279 Jul 21 20:56:10.789761 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 241/466] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:10 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:10.988871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:10.990147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:10.997969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:10.998568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:10.999451 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:11.000166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:11.203667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:11.215603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-38a4e5d0-3951-48a4-8f8f-28dc838c8b55 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.237587 Jul 21 20:56:11.217389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 226/467] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:10 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:11.807101 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:11.807882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:11.810036 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:11.816027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:11.816709 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:11.817670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:11.819294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:11.918934 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:11.926954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b9de4c11-ac48-43d8-b2af-8e8c3f0b0ce7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1303 microversion: 2.1 time: 0.125211 Jul 21 20:56:11.938059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 242/468] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:11 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:12.234375 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:12.235780 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:12.247398 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:12.247969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:12.248963 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:12.249622 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:12.477742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:12.490727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a2edcdb9-2c3f-4c63-988a-1e1298c71bc6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.258793 Jul 21 20:56:12.493042 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 227/469] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:12 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:12.946231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:12.947501 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:12.957798 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:12.958477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:12.959270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:12.960169 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:13.139308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:13.149910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a36e9e4e-3d58-4128-879e-25c4eb04510e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.208686 Jul 21 20:56:13.150493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 243/470] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:12 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:13.508553 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:13.509779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:13.523090 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:13.523947 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:13.525187 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:13.525846 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:14.103212 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:14.114000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5e891ad0-aa9a-4530-9af8-20a318dff467 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.609903 Jul 21 20:56:14.114588 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 228/471] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:13 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:14.168813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:14.170401 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:14.179388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:14.179894 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:14.181042 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:14.181720 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:14.412816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:14.427646 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dee64288-565e-422f-9e1a-af758f50b31e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.264910 Jul 21 20:56:14.428836 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 244/472] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:14 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:15.133559 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:15.134797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:15.143048 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:15.143858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:15.144824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:15.145465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:15.306354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:15.316534 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-54744b9f-1002-482b-aeab-0145d49bef33 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.187258 Jul 21 20:56:15.317952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 229/473] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:15 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:15.445738 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:15.446954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:15.455551 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:15.456824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:15.457955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:15.463303 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:15.996001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:16.007107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a9517634-2d5f-4fb7-81c1-c866b3184c7b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.564633 Jul 21 20:56:16.016842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 245/474] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:15 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:16.339056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:16.339683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:16.348941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:16.354447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:16.356693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:16.369307 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:16.688574 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-4f2336bc-2d7d-4276-880e-94be58b80f7e req-a21d944f-8544-478f-8c99-5d467c7ea6bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ceb90ef-75ce-4b77-85a4-8441a15b41ce", "tag": "e57d7145-76e9-4c5b-a742-c7da860acb28"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:16.716475 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-4f2336bc-2d7d-4276-880e-94be58b80f7e req-a21d944f-8544-478f-8c99-5d467c7ea6bb service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:16.719611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-4f2336bc-2d7d-4276-880e-94be58b80f7e req-a21d944f-8544-478f-8c99-5d467c7ea6bb service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:16.753418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-4f2336bc-2d7d-4276-880e-94be58b80f7e req-a21d944f-8544-478f-8c99-5d467c7ea6bb service nova] Creating event network-changed:e57d7145-76e9-4c5b-a742-c7da860acb28 for instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce on hv-cinder-85068 Jul 21 20:56:16.768060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-4f2336bc-2d7d-4276-880e-94be58b80f7e req-a21d944f-8544-478f-8c99-5d467c7ea6bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085606 Jul 21 20:56:16.769053 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 246/475] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:56:16.775754 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:16.792664 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ed9481bb-9681-4b13-8643-bb4844362182 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.461106 Jul 21 20:56:16.804684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 230/476] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:16 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:17.025676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:17.026388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:17.043913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:17.045010 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:17.046263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:17.046868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:17.188116 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:17.365038 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:17.374643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=12 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:17.380892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-340bbffe-b732-4f5f-9432-ac4027c167f5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.359978 Jul 21 20:56:17.382034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 247/477] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:17 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:17.811169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:17.811986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:17.820715 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:17.821602 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:17.822552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:17.823236 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:18.106532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:18.118073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7de61fa7-f89d-432e-8a9e-bedc553dd0c7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.310775 Jul 21 20:56:18.118905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 231/478] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:17 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:18.407462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:18.408801 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:18.418549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:18.420217 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:18.421712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:18.423741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:18.625871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:18.641409 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1ce2654c-fac9-4632-ac9d-87027b266087 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.239803 Jul 21 20:56:18.641409 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 248/479] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:18 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:19.137722 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:19.138397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:19.144855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:19.145603 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:19.146586 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:19.147212 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:19.289019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-78c3b1ac-3828-4d7e-8426-86b0a29c7c19 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Action: 'create', calling method: .version_select at 0x7f3540cb5f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1053486654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPkh8Aq2qaOfdVU74j6VJe6M+YZ45gN6csKqBsE4dUPC03UlQK3s1T8lqQhOstMbZL/TJ2LxfuGSDp0Es97UkYjPRFGG8340uS85lrhYhoc2XNgk/UCEHt4Y6YGj6pNJw=="}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:19.314671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-78c3b1ac-3828-4d7e-8426-86b0a29c7c19 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:56:19.319294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-78c3b1ac-3828-4d7e-8426-86b0a29c7c19 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for user 2b3617b8bcac4227b1295e294eec664a and project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:56:19.325333 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:19.333411 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-01315929-2de5-4c55-8c47-3bc949d6bcd1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.202668 Jul 21 20:56:19.334089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 249/480] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:19 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:56:19.360381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-78c3b1ac-3828-4d7e-8426-86b0a29c7c19 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.326484 Jul 21 20:56:19.361036 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 232/481] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 20:56:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:56:19.654597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:19.655940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:19.663445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:19.664210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:19.665251 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:19.666126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:19.799938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-5c59b4ed-6dfc-462c-8ba8-e8c74443d7a0 req-806ae6cd-3bf6-4d92-970c-b439dca89e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b193b823-d7ce-4e16-9404-d2c5984dfa9c", "name": "network-vif-plugged", "status": "completed", "tag": "91c59827-c0f0-43a1-a399-6c68970a550b"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:19.814142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-5c59b4ed-6dfc-462c-8ba8-e8c74443d7a0 req-806ae6cd-3bf6-4d92-970c-b439dca89e59 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:19.814783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-5c59b4ed-6dfc-462c-8ba8-e8c74443d7a0 req-806ae6cd-3bf6-4d92-970c-b439dca89e59 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:19.830533 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-5c59b4ed-6dfc-462c-8ba8-e8c74443d7a0 req-806ae6cd-3bf6-4d92-970c-b439dca89e59 service nova] Creating event network-vif-plugged:91c59827-c0f0-43a1-a399-6c68970a550b for instance b193b823-d7ce-4e16-9404-d2c5984dfa9c on hv-cinder-85068 Jul 21 20:56:19.836095 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-5c59b4ed-6dfc-462c-8ba8-e8c74443d7a0 req-806ae6cd-3bf6-4d92-970c-b439dca89e59 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040141 Jul 21 20:56:19.837035 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 233/482] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:56:19.878091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:19.890375 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8e2bd991-614f-4056-8191-dcb9464941b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.239676 Jul 21 20:56:19.891172 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 250/483] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:19 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:20.373051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:20.375337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:20.413724 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:20.423350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:20.425300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:20.426084 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:20.730033 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:20.738674 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-32f8d38f-1f1c-4668-b8cc-285a7853b884 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.390853 Jul 21 20:56:20.749425 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 234/484] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:20 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:20.908792 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:20.909457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:20.917682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:20.918539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:20.919602 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:20.920930 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:21.094582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:21.104465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1f6443cf-f8a6-4d74-b106-fcbf207240af tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.200560 Jul 21 20:56:21.105508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 251/485] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:20 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:21.756938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:21.757562 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:21.765297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:21.765966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:21.766912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:21.767407 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:21.943381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:21.951119 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7d43646a-e66e-4936-a4b7-8dee2e28c48f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.198294 Jul 21 20:56:21.951691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 235/486] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:21 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:22.121772 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:22.122286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:22.128331 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:22.128784 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:22.129547 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:22.129987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:22.263234 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:22.272962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-33ef22cb-9663-4c7e-8df6-ed863c53b805 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.154959 Jul 21 20:56:22.273647 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 252/487] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:22 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:22.968728 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:22.969343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:22.976104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:22.976558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:22.977317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:22.977754 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:23.111390 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:23.119396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ce02002e-d86a-4d0a-ab45-d9bbad7783f7 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.154557 Jul 21 20:56:23.120023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 236/488] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:22 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:23.291161 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:23.291884 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:23.298268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:23.298833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:23.299751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:23.300303 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:23.482194 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:23.491609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-58045dee-db6c-4e44-8bb4-7f96b1b7d7dc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.205136 Jul 21 20:56:23.494652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 253/489] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:23 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:24.140290 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:24.141790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:24.149718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:24.150603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:24.151699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:24.153474 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:24.436841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:24.441073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:24.446546 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fb8be283-d316-4b2c-ac9c-5823a8d1d105 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1318 microversion: 2.1 time: 0.311463 Jul 21 20:56:24.447925 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 237/490] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:24 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:24.512631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:24.513253 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:24.526882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:24.527327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:24.530733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:24.543816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:24.845572 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:24.855669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2a0d5112-f8df-43b8-a24a-9f55b75d38d8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.351177 Jul 21 20:56:24.858188 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 254/491] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:24 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:56:25.462836 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:25.464225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:25.470372 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:25.470830 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:25.471601 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:25.472076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:25.603203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:25.610743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4c247e6a-31b6-4995-88ba-bec31f9f6c93 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1505 microversion: 2.1 time: 0.152255 Jul 21 20:56:25.611585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 238/492] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:25 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:25.875759 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:25.876374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:25.882757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:25.883313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:25.884014 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:25.884522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:25.889890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:26.032093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:26.041111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-203a87f4-a8c1-4b15-8798-edb33d6db1bc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.169360 Jul 21 20:56:26.041679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 255/493] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:25 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:26.233965 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-659786c8-73b8-4bb0-9e9a-6c68e0d1b322 req-50bcc8d3-0f91-4f13-9008-6fa9deafac23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ceb90ef-75ce-4b77-85a4-8441a15b41ce", "name": "network-vif-plugged", "status": "completed", "tag": "e57d7145-76e9-4c5b-a742-c7da860acb28"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:26.243316 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-659786c8-73b8-4bb0-9e9a-6c68e0d1b322 req-50bcc8d3-0f91-4f13-9008-6fa9deafac23 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:26.243881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-659786c8-73b8-4bb0-9e9a-6c68e0d1b322 req-50bcc8d3-0f91-4f13-9008-6fa9deafac23 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:26.256361 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-659786c8-73b8-4bb0-9e9a-6c68e0d1b322 req-50bcc8d3-0f91-4f13-9008-6fa9deafac23 service nova] Creating event network-vif-plugged:e57d7145-76e9-4c5b-a742-c7da860acb28 for instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce on hv-cinder-85068 Jul 21 20:56:26.266052 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-659786c8-73b8-4bb0-9e9a-6c68e0d1b322 req-50bcc8d3-0f91-4f13-9008-6fa9deafac23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Jul 21 20:56:26.266752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 239/494] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:56:27.057108 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:27.057726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:27.063697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:27.064173 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:27.064946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:27.065385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:27.205744 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:27.213210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2abf467f-2e51-4b4c-85b0-fcc8954f446e tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.160158 Jul 21 20:56:27.213794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 256/495] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:27 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:28.230443 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:28.231138 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:28.237845 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:28.238413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:28.239318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:28.239842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:28.378248 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:28.386688 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-17019759-c018-4be9-b63f-db2e0691e115 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1371 microversion: 2.1 time: 0.161068 Jul 21 20:56:28.387295 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 240/496] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:28 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:29.405065 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:29.405719 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:29.411953 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:29.412397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:29.413163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:29.413599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:29.549318 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:29.557734 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3876db1f-84dc-406e-9356-555f7366e878 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1565 microversion: 2.1 time: 0.157568 Jul 21 20:56:29.560055 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 257/497] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:29 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:29.574269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ae3df5a0-ff03-4b87-8b2b-9cfb3cde7789 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:29.574805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ae3df5a0-ff03-4b87-8b2b-9cfb3cde7789 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:29.577146 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=4 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:29.582480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae3df5a0-ff03-4b87-8b2b-9cfb3cde7789 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:29.582918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae3df5a0-ff03-4b87-8b2b-9cfb3cde7789 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:29.583670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae3df5a0-ff03-4b87-8b2b-9cfb3cde7789 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:29.584196 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae3df5a0-ff03-4b87-8b2b-9cfb3cde7789 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:29.666367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ae3df5a0-ff03-4b87-8b2b-9cfb3cde7789 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095835 Jul 21 20:56:29.666972 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 241/498] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 20:56:29 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:56:30.869527 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-6bcb92b6-e015-4f28-b15a-f8742be78a9a req-56e17b44-07c1-411f-9164-fa3599af247f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ceb90ef-75ce-4b77-85a4-8441a15b41ce", "tag": "e57d7145-76e9-4c5b-a742-c7da860acb28"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:30.882153 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-6bcb92b6-e015-4f28-b15a-f8742be78a9a req-56e17b44-07c1-411f-9164-fa3599af247f service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:30.882675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-6bcb92b6-e015-4f28-b15a-f8742be78a9a req-56e17b44-07c1-411f-9164-fa3599af247f service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:30.894599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-6bcb92b6-e015-4f28-b15a-f8742be78a9a req-56e17b44-07c1-411f-9164-fa3599af247f service nova] Creating event network-changed:e57d7145-76e9-4c5b-a742-c7da860acb28 for instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce on hv-cinder-85068 Jul 21 20:56:30.902346 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-6bcb92b6-e015-4f28-b15a-f8742be78a9a req-56e17b44-07c1-411f-9164-fa3599af247f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036420 Jul 21 20:56:30.903024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 258/499] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:56:55.220153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:55.220962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=18 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:55.225384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-419736370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1053486654", "security_groups": [{"name": "tempest-secgroup-smoke-1588311094"}], "block_device_mapping_v2": [{"uuid": "577c4d47-9765-4667-a53a-2d71f077c165", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4b6565cd-3bec-4ff7-8320-fd7b78910885"}]}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:55.338655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] validate_networks() for [('4b6565cd-3bec-4ff7-8320-fd7b78910885', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:56:55.706601 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:56:55.707017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:56:55.707513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:56:55.707947 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:56:55.708355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:56:55.717279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:55.717721 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:55.718501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:55.718932 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:55.736898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:56:55.740810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for user 2b3617b8bcac4227b1295e294eec664a and project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:56:55.796392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:56:55.798482 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='577c4d47-9765-4667-a53a-2d71f077c165',volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:56:55.947179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6e4c1bba-f7dc-4981-8183-ddc8af7aa377 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728333 Jul 21 20:56:55.947846 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 242/500] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:56:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:56:55.956027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=33 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:55.956658 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=18 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:56:55.961109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-98f85582-d461-4176-893a-f0d328094dc4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:55.961817 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-98f85582-d461-4176-893a-f0d328094dc4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:56.017591 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-98f85582-d461-4176-893a-f0d328094dc4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:56.024296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-98f85582-d461-4176-893a-f0d328094dc4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1094 microversion: 2.1 time: 0.070259 Jul 21 20:56:56.024854 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 259/501] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:55 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:57.042570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:57.043514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:57.050586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:57.051112 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:57.051979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:57.052498 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:57.118346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:57.128037 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-79665039-84a3-4a23-94c9-83a584b88185 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1200 microversion: 2.1 time: 0.089649 Jul 21 20:56:57.128717 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 243/502] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:57 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:58.146073 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:58.146601 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:58.153489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:58.153946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:58.154721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:58.155391 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:58.419068 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:58.426513 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7a736abb-69e9-4c46-9c7a-3ad414f04d91 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.284415 Jul 21 20:56:58.427079 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 260/503] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:58 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:56:58.798057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-a0b07a29-9ec2-476d-bcbb-f0ca241efddf req-74528cc9-9e9d-48dc-8f1c-878e56899650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528c37e5-c939-4326-bb37-7b63c853560d", "tag": "3456dc7f-b173-4681-b12b-4f70ac0bfa5e"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:56:58.807136 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-a0b07a29-9ec2-476d-bcbb-f0ca241efddf req-74528cc9-9e9d-48dc-8f1c-878e56899650 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:58.807584 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-a0b07a29-9ec2-476d-bcbb-f0ca241efddf req-74528cc9-9e9d-48dc-8f1c-878e56899650 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:58.822277 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-a0b07a29-9ec2-476d-bcbb-f0ca241efddf req-74528cc9-9e9d-48dc-8f1c-878e56899650 service nova] Creating event network-changed:3456dc7f-b173-4681-b12b-4f70ac0bfa5e for instance 528c37e5-c939-4326-bb37-7b63c853560d on hv-cinder-85068 Jul 21 20:56:58.828612 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-a0b07a29-9ec2-476d-bcbb-f0ca241efddf req-74528cc9-9e9d-48dc-8f1c-878e56899650 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034304 Jul 21 20:56:58.829487 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 244/504] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:56:59.444531 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:56:59.445144 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:56:59.452066 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:59.452516 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:59.453278 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:56:59.453715 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:56:59.581435 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:56:59.588926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-04670958-025d-49e9-ab88-2aa73bdf8d67 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.148254 Jul 21 20:56:59.589493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 261/505] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:56:59 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:00.607053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:00.607642 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:00.614198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:00.614648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:00.615411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:00.615890 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:00.708240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4f5647b8-9ac6-4e23-b8f4-90947df857c6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1838cafe-4d2f-4296-8073-beb360913fd9", "device": "/dev/sdb"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:00.709867 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4f5647b8-9ac6-4e23-b8f4-90947df857c6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:00.716738 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4f5647b8-9ac6-4e23-b8f4-90947df857c6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:00.717402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4f5647b8-9ac6-4e23-b8f4-90947df857c6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:00.718178 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4f5647b8-9ac6-4e23-b8f4-90947df857c6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:00.718608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4f5647b8-9ac6-4e23-b8f4-90947df857c6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:00.753026 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:00.760795 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-240b9b8d-c65b-4f35-b85e-b4d2773bb592 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.158520 Jul 21 20:57:00.761581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 245/506] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:00 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:01.010095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4f5647b8-9ac6-4e23-b8f4-90947df857c6 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "POST /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305529 Jul 21 20:57:01.013792 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 262/507] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 20:57:00 2022] POST /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:57:01.777585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:01.778835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:01.785510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:01.785960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:01.786804 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:01.787241 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:01.923851 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:01.931317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-51a070ca-31b4-4925-bb83-3e9a908b182a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.157772 Jul 21 20:57:01.931917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 246/508] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:01 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:02.949056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:02.949748 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:02.956449 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:02.956895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:02.957662 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:02.958093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:03.087515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:03.095175 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7c1c8254-14d9-4a7a-ba39-eb1fa7dc7038 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.150791 Jul 21 20:57:03.095758 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 263/509] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:02 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:04.112870 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:04.113486 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:04.119997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:04.120465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:04.121249 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:04.121692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:04.257529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:04.265095 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9091df20-188f-4426-af9c-915bf6f19ef3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.156431 Jul 21 20:57:04.265670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 247/510] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:04 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:05.281595 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:05.282213 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:05.288808 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:05.289252 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:05.290017 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:05.290455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:05.429045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:05.437344 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1d508920-44ba-4721-b29b-5d715c7c6ef2 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.159567 Jul 21 20:57:05.437903 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 264/511] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:05 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:06.454361 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:06.454968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:06.456935 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:06.457583 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:06.463133 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:06.463576 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:06.464392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:06.464825 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:06.597147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:06.606058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cb07e733-8ff2-47e1-b995-024e2072fdec tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.155958 Jul 21 20:57:06.607399 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 248/512] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:06 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:07.624121 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:07.624679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:07.627104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:07.632908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:07.633367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:07.634140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:07.634608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:07.764953 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:07.772517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f6af843f-6466-48f0-ae89-5093011116dd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.152972 Jul 21 20:57:07.773084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 265/513] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:07 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:08.789742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:08.790354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:08.796993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:08.797440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:08.798203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:08.798640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:08.929469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:08.938899 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f99cc56a-3050-489c-883e-98dd322e173c tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.152734 Jul 21 20:57:08.939701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 249/514] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:08 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:09.957262 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:09.957828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:09.964402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:09.964853 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:09.965730 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:09.966273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:10.100673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:10.108870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e035e38e-0c4e-434c-bc08-75aa4e16c892 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.155537 Jul 21 20:57:10.109453 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 266/515] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:09 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:11.126810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:11.127958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:11.136265 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:11.136719 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:11.137558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:11.138201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:11.268688 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:11.276047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-befd437c-70b9-4907-a3ae-8123653ccb13 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.154316 Jul 21 20:57:11.276622 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 250/516] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:11 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:12.293540 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:12.294880 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:12.301493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:12.301931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:12.302857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:12.303296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:12.434864 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:12.442659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7eeb906d-cd3a-4e4d-8a6a-8d0f7d1ff0bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.153028 Jul 21 20:57:12.443220 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 267/517] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:12 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:13.459230 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:13.459854 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:13.466969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:13.467415 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:13.468209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:13.468641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:13.601859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:13.609283 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c3290502-3586-48c5-acd0-4e6a11590834 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.153869 Jul 21 20:57:13.609849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 251/518] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:13 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:14.626503 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:14.627036 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:14.633573 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:14.634024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:14.634792 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:14.635233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:14.767941 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:14.775433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-195a17bb-fd45-4c88-acb1-3813c8ce9c6a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.152908 Jul 21 20:57:14.776048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 268/519] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:14 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:15.792682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:15.793239 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:15.800259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:15.800710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:15.801471 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:15.801910 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:15.934139 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:15.941935 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-29f94d1a-daab-4fee-ba55-7c341d5448fd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.153394 Jul 21 20:57:15.942590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 252/520] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:15 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:16.958818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:16.959400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:16.965925 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:16.966366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:16.967120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:16.967546 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:17.103898 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:17.111692 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4c19c584-1dab-46ae-95d5-fe1c4d55ee21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.156462 Jul 21 20:57:17.112267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 269/521] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:16 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:18.128202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:18.128837 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:18.135389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:18.135857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:18.136613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:18.137047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:18.273478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:18.280930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-68c28344-c07d-45a4-9edb-9fc8b3a4b385 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.156602 Jul 21 20:57:18.281488 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 253/522] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:18 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:19.298150 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:19.298821 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:19.305525 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:19.305973 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:19.306733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:19.307172 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:19.438362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:19.445760 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7d1903c5-1acc-4115-875f-78727cd4dccd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.151578 Jul 21 20:57:19.446316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 270/523] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:19 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:20.462653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:20.463196 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:20.470214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:20.470664 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:20.471962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:20.472486 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:20.604225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:20.612640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d2b9e5d5-9f99-412d-8c9f-f5a129d686f0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.153895 Jul 21 20:57:20.613217 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 254/524] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:20 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:20.977232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-34dc266f-050f-470b-ac9d-2e778b5e8a1e req-fb06e2bb-d34b-4411-9718-dc6f9cfebdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528c37e5-c939-4326-bb37-7b63c853560d", "name": "network-vif-plugged", "status": "completed", "tag": "3456dc7f-b173-4681-b12b-4f70ac0bfa5e"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:20.985935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-34dc266f-050f-470b-ac9d-2e778b5e8a1e req-fb06e2bb-d34b-4411-9718-dc6f9cfebdc4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:20.986642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-34dc266f-050f-470b-ac9d-2e778b5e8a1e req-fb06e2bb-d34b-4411-9718-dc6f9cfebdc4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:20.998607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-34dc266f-050f-470b-ac9d-2e778b5e8a1e req-fb06e2bb-d34b-4411-9718-dc6f9cfebdc4 service nova] Creating event network-vif-plugged:3456dc7f-b173-4681-b12b-4f70ac0bfa5e for instance 528c37e5-c939-4326-bb37-7b63c853560d on hv-cinder-85068 Jul 21 20:57:21.003526 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-34dc266f-050f-470b-ac9d-2e778b5e8a1e req-fb06e2bb-d34b-4411-9718-dc6f9cfebdc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030002 Jul 21 20:57:21.004167 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 271/525] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:57:21.286517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f632e628-70fd-491b-a87b-01acd7d895c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:21.287232 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f632e628-70fd-491b-a87b-01acd7d895c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:21.295445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f632e628-70fd-491b-a87b-01acd7d895c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:21.295987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f632e628-70fd-491b-a87b-01acd7d895c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:21.296837 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f632e628-70fd-491b-a87b-01acd7d895c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:21.297285 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f632e628-70fd-491b-a87b-01acd7d895c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:21.323096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f632e628-70fd-491b-a87b-01acd7d895c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/ips" status: 200 len: 151 microversion: 2.20 time: 0.041209 Jul 21 20:57:21.323888 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 255/526] 10.222.0.60 () {60 vars in 1288 bytes} [Thu Jul 21 20:57:21 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:57:21.630338 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:21.631087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:21.637588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:21.638145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:21.639086 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:21.639529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:21.779793 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:21.788107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1a8069f7-b855-4567-b56e-06e350ba546a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.162039 Jul 21 20:57:21.788681 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 272/527] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:21 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:22.805388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:22.806007 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:22.813309 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:22.813763 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:22.814527 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:22.814966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:22.947967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:22.955343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b261f0bb-b8a5-4df5-bd90-408c9c69c02d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.153794 Jul 21 20:57:22.955935 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 256/528] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:22 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:23.971466 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:23.972029 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:23.978462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:23.978909 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:23.979674 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:23.980132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:24.110555 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:24.118185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c585ccad-d66c-4f78-8741-ca333c132e42 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.150584 Jul 21 20:57:24.118742 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 273/529] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:23 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:25.134515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:25.135254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:25.142051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:25.142502 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:25.143265 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:25.143699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:25.273223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:25.275395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=85 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:25.281669 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7de339b3-1050-48ad-9627-2f2bdfb5b3fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.150990 Jul 21 20:57:25.282232 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 257/530] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:25 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:26.298956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:26.299562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:26.301979 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=33 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:26.307351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:26.307818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:26.308578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:26.309672 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:26.312546 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:26.445834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:26.453949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-97972321-d1fa-4c28-9e20-fb5a469f164a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.158789 Jul 21 20:57:26.454499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 274/531] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:26 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:27.471006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:27.471663 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:27.474186 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:27.479687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:27.480182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:27.481123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:27.481572 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:27.779486 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:27.787045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-00f9d36a-4ba7-41ef-9ad3-11d852cabb21 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1266 microversion: 2.1 time: 0.319949 Jul 21 20:57:27.787621 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 258/532] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:27 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:28.474063 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:28.474623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:28.481266 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.481707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:28.482462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.482891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:28.505727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lazy-loading 'flavor' on Instance uuid b6b1f12b-2ec1-4e9b-ac1b-61385f597069 {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:57:28.804597 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:28.805232 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:28.811943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.812383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:28.813163 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.813663 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:28.864865 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-006716b4-095c-4202-a029-7e0d2b23b626 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/action" status: 202 len: 0 microversion: 2.20 time: 0.394554 Jul 21 20:57:28.865637 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 275/533] 10.222.0.60 () {62 vars in 1318 bytes} [Thu Jul 21 20:57:28 2022] POST /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:57:28.874518 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:28.875240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:28.882857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.883241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:28.884107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.885183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:28.962670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:28.971563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1060cb2b-6d3c-4565-8749-8edc572db8f9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1452 microversion: 2.1 time: 0.170784 Jul 21 20:57:28.972161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 259/534] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:28 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:57:28.988977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:28.989856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:28.995898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.996741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:28.997270 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:28.997712 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:29.028868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:29.036947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:29.038450 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:29.039675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6b50c49c-7be9-4905-9eea-cfb405c8ec67 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.169737 Jul 21 20:57:29.040260 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 276/535] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:28 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:57:29.132856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:29.140770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3bcb79d8-abc1-4df6-8d71-827726489f9b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1452 microversion: 2.1 time: 0.156141 Jul 21 20:57:29.141336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 260/536] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:28 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:57:30.059599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:30.060485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:30.071141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:30.071931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:30.072833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:30.073270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:30.210767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:30.219311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:30.220881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:30.222058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fba2f681-5c7c-48c4-8328-84a1029cf450 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.166921 Jul 21 20:57:30.233338 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 277/537] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:30 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:30.835676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-d1f909c9-5de6-4637-8ed4-1877a58bac23 req-90bbe132-f732-4fbc-a5d1-6d7e7e014a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528c37e5-c939-4326-bb37-7b63c853560d", "tag": "3456dc7f-b173-4681-b12b-4f70ac0bfa5e"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:30.844014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-d1f909c9-5de6-4637-8ed4-1877a58bac23 req-90bbe132-f732-4fbc-a5d1-6d7e7e014a42 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:30.844455 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-d1f909c9-5de6-4637-8ed4-1877a58bac23 req-90bbe132-f732-4fbc-a5d1-6d7e7e014a42 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:30.855776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-d1f909c9-5de6-4637-8ed4-1877a58bac23 req-90bbe132-f732-4fbc-a5d1-6d7e7e014a42 service nova] Creating event network-changed:3456dc7f-b173-4681-b12b-4f70ac0bfa5e for instance 528c37e5-c939-4326-bb37-7b63c853560d on hv-cinder-85068 Jul 21 20:57:30.862492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-d1f909c9-5de6-4637-8ed4-1877a58bac23 req-90bbe132-f732-4fbc-a5d1-6d7e7e014a42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030396 Jul 21 20:57:30.863581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 261/538] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:57:30.883888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:30.884385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:30.891252 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:30.891808 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:30.892636 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:30.893135 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:31.023562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lazy-loading 'services' on Instance uuid b193b823-d7ce-4e16-9404-d2c5984dfa9c {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:57:31.149211 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3e834ea9-8c43-43b9-b191-434ebdcd823a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c/os-volume_attachments/1838cafe-4d2f-4296-8073-beb360913fd9" status: 202 len: 0 microversion: 2.1 time: 0.269029 Jul 21 20:57:31.150691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 278/539] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 20:57:30 2022] DELETE /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c/os-volume_attachments/1838cafe-4d2f-4296-8073-beb360913fd9 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:57:31.241186 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:31.241943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:31.250268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:31.250725 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:31.251546 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:31.251956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:31.409449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:31.417649 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:31.420242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:31.421461 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3b48efe2-bfc8-4ad5-9f3a-090ff8132a36 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.184498 Jul 21 20:57:31.422032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 262/540] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:31 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:32.440836 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:32.441529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:32.448280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:32.448729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:32.449490 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:32.449927 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:32.577796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:32.585721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:32.587214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:32.588394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8ef36ce6-4161-4d77-ab03-5f03372fbb8f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.152341 Jul 21 20:57:32.588977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 279/541] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:32 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:33.346542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:33.347044 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:33.353584 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:33.354038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:33.354805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:33.355248 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:33.381073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Going to try to terminate instance {{(pid=124647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:57:33.456268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2b700d79-56b6-41a1-98aa-88ba76f53762 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 204 len: 0 microversion: 2.1 time: 0.113235 Jul 21 20:57:33.457123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 263/542] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 20:57:33 2022] DELETE /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:57:33.465419 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:33.466153 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:33.472774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:33.473221 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:33.473978 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:33.474412 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:33.604342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:33.608101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:33.608835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:33.612764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-84d87480-0ee6-4abf-b830-3bad73af6a21 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1511 microversion: 2.1 time: 0.151292 Jul 21 20:57:33.613334 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 280/543] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:33 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:33.615206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:33.615660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:33.616468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:33.616910 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:33.749351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:33.757499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:33.758998 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:33.760193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-77170b98-bb2c-4d5f-89aa-6ca9e452ccfb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.157361 Jul 21 20:57:33.760764 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 264/544] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:33 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:34.630491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:34.631055 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:34.637927 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:34.638372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:34.639163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:34.639594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:34.768881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:34.776376 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0eacd3f7-9c89-4ab7-9741-3efe479d949f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1511 microversion: 2.1 time: 0.149791 Jul 21 20:57:34.776940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 281/545] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:34 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:34.778984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:34.779597 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:34.786114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:34.786565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:34.787342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:34.787807 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:34.918593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:34.926574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:34.928107 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:34.929280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-eac4bed4-34c5-479c-8189-15fd1c36f10b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.154831 Jul 21 20:57:34.929838 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 265/546] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:34 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:57:35.794127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:35.794673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:35.801055 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:35.801550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:35.802300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:35.802735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:35.933461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:35.941380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e376ff28-7e62-4afa-8d1a-c5cdc93b7715 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1511 microversion: 2.1 time: 0.151211 Jul 21 20:57:35.941962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 282/547] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:35 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:35.947545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:35.948445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:35.956469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:35.957221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:35.958604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:35.959417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:36.092770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:36.100699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:36.102184 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:36.103332 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8411dca7-482d-407b-8f2a-f067e3b55f5d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.159629 Jul 21 20:57:36.103927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 266/548] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:35 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:36.631961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-0d10196c-4b7f-4ff2-8f64-789825843197 req-2d6f72b1-5ea3-45c2-88a7-a8049a04b4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b193b823-d7ce-4e16-9404-d2c5984dfa9c", "name": "network-vif-deleted", "tag": "91c59827-c0f0-43a1-a399-6c68970a550b"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:36.641721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-0d10196c-4b7f-4ff2-8f64-789825843197 req-2d6f72b1-5ea3-45c2-88a7-a8049a04b4a8 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:36.642901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-0d10196c-4b7f-4ff2-8f64-789825843197 req-2d6f72b1-5ea3-45c2-88a7-a8049a04b4a8 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:36.656451 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-0d10196c-4b7f-4ff2-8f64-789825843197 req-2d6f72b1-5ea3-45c2-88a7-a8049a04b4a8 service nova] Creating event network-vif-deleted:91c59827-c0f0-43a1-a399-6c68970a550b for instance b193b823-d7ce-4e16-9404-d2c5984dfa9c on hv-cinder-85068 Jul 21 20:57:36.661684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-0d10196c-4b7f-4ff2-8f64-789825843197 req-2d6f72b1-5ea3-45c2-88a7-a8049a04b4a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034956 Jul 21 20:57:36.662290 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 283/549] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:57:36.959209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:36.959847 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:36.966487 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:36.966938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:36.967702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:36.968169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:36.999611 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:37.000085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:37.000556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lazy-loading 'fault' on Instance uuid b193b823-d7ce-4e16-9404-d2c5984dfa9c {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:57:37.044946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:37.052425 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b7ac1258-540c-4d35-9705-74d389cf679a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 200 len: 1308 microversion: 2.1 time: 0.097073 Jul 21 20:57:37.052995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 267/550] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:36 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:37.122936 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:37.123633 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:37.130316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:37.130762 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:37.131522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:37.131991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:37.268462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:37.276910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:37.279658 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:37.280907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d454296b-3c70-4a72-b493-591a7c7215c4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.162290 Jul 21 20:57:37.281482 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 284/551] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:37 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:38.069242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:38.069862 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: b193b823-d7ce-4e16-9404-d2c5984dfa9c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:38.076856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:38.077305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:38.078070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:38.078508 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:38.092374 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] HTTP exception thrown: Instance b193b823-d7ce-4e16-9404-d2c5984dfa9c could not be found. Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Request method failure captured: Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c HTTP/1.1 Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b1MPKq_t87A9SaMu48yQVsgHXrzGK0OpvH4EkrAZvEDxszr5G5q1NLEauMU9jabNGNUO7ikuUY-oAsKq6IbigSn18mFOgbizGsEjyiWSBamIzP13XL8SlF-jPftld8rme8hsA7rsg6kdPZgD_MpLSw3fO4VB6Pi220vhJHawjdwqwM Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 98e1d76644d94fd9ada9ff1ae3267bf8 Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1159198546 Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 20:57:38.094000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-VolumesSnapshotTestJSON-1159198546 Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 98e1d76644d94fd9ada9ff1ae3267bf8 Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1159198546 Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-VolumesSnapshotTestJSON-1159198546-project Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: cc44212b992e4358bb37a1f8c4a6a77c Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-VolumesSnapshotTestJSON-1159198546-project Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance b193b823-d7ce-4e16-9404-d2c5984dfa9c could not be found. Jul 21 20:57:38.095356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'b193b823-d7ce-4e16-9404-d2c5984dfa9c'} Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b193b823-d7ce-4e16-9404-d2c5984dfa9c could not be found. Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:57:38.096244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b193b823-d7ce-4e16-9404-d2c5984dfa9c could not be found. Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b193b823-d7ce-4e16-9404-d2c5984dfa9c could not be found. Jul 21 20:57:38.097702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:57:38.098986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Returning 404 to user: Instance b193b823-d7ce-4e16-9404-d2c5984dfa9c could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:57:38.098986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-edef1890-287e-4f54-98d1-ca8e7bdcf4cf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c" status: 404 len: 111 microversion: 2.1 time: 0.030034 Jul 21 20:57:38.098986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 268/552] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:38 2022] GET /compute/v2.1/servers/b193b823-d7ce-4e16-9404-d2c5984dfa9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 20:57:38.298741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:38.299455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:38.305959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:38.306408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:38.307167 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:38.307603 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:38.439609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:38.447574 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:38.449102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:38.451202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-35fe6930-0acb-4edb-9ac6-2fd59e80783c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.155384 Jul 21 20:57:38.452057 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 285/553] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:38 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:39.469641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:39.470246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:39.477144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:39.477621 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:39.478373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:39.478802 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:39.608287 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:39.616994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:39.618490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:39.619637 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-485e9a28-b93e-4306-abdc-8b41f665aff2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.153949 Jul 21 20:57:39.620260 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 269/554] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:39 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:40.638448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:40.639089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:40.645777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:40.646226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:40.646995 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:40.647434 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:40.773689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:40.782096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:40.783608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:40.784791 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f96f242b-a72b-47ff-ac2e-840bb54a795a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.150318 Jul 21 20:57:40.785351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 286/555] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:40 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:41.803685 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:41.804223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:41.811200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:41.811643 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:41.812424 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:41.812860 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:41.945160 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:41.952960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:41.954453 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:41.955605 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-400d1d11-4b00-4189-b1d6-cedcb78bf89d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.155882 Jul 21 20:57:41.956193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 270/556] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:41 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:42.974521 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:42.975129 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:42.981636 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:42.982071 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:42.982821 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:42.983249 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:43.116820 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:43.125074 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:43.126749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:43.127935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d2415df9-cdbb-4309-8e66-5d7165a08b81 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.157216 Jul 21 20:57:43.128489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 287/557] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:42 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:44.146155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:44.146768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:44.153338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:44.153793 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:44.155077 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:44.155619 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:44.286966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:44.295003 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:44.296627 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:44.297782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-00f255f4-c092-4e2d-897c-96946ab6c8ff tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.155656 Jul 21 20:57:44.298350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 271/558] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:44 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:45.419770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:45.420916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:45.426893 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:45.427327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:45.428102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:45.428531 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:45.553466 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:45.555858 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:45.563634 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:45.565213 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:45.566365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2437c948-b6a4-4737-a101-601f752858e2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.253364 Jul 21 20:57:45.566929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 288/559] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:45 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:46.584946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:46.585554 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:46.592419 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:46.593016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:46.593780 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:46.594220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:46.722045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:46.729979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:46.731483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:46.733383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-775c7847-940a-49af-a82c-2157342934b9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.151637 Jul 21 20:57:46.733951 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 272/560] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:46 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:47.752075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:47.752685 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:47.760261 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:47.760740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:47.761508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:47.761944 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:47.892183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:47.899977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:47.901464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:47.902651 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8751bd76-a507-4c78-a1a8-150ecae6d527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.154617 Jul 21 20:57:47.903198 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 289/561] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:47 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:48.921108 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:48.921716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:48.928205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:48.928649 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:48.929410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:48.929845 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:49.067270 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:49.069594 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:49.076648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:49.078152 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:49.079316 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-36a3d3a8-d25e-4a3f-8e01-5963e9dd9c6f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.162631 Jul 21 20:57:49.079903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 273/562] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:48 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:50.009075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-377288925", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "networks": [{"uuid": "133dba56-f9b1-4b52-b38c-7b3ffc5be897"}]}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:50.059553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] validate_networks() for [('133dba56-f9b1-4b52-b38c-7b3ffc5be897', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 20:57:50.098618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:50.099246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:50.106882 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:50.107535 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:50.108618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:50.109049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:50.240859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:50.248862 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:50.250440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:50.251538 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b377816d-6399-4de6-b933-06bf15234c7b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.157644 Jul 21 20:57:50.252120 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 274/563] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:50 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:57:50.406492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 20:57:50.406912 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 20:57:50.407383 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 20:57:50.407818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 20:57:50.408230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 20:57:50.423704 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:50.424168 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:50.424961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:50.425432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:50.442763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Getting quotas for project 98e1d76644d94fd9ada9ff1ae3267bf8. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 20:57:50.446743 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Getting quotas for user cc44212b992e4358bb37a1f8c4a6a77c and project 98e1d76644d94fd9ada9ff1ae3267bf8. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 20:57:50.457828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 20:57:50.460089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 20:57:50.504895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-603948fd-195a-4efd-831b-17daaaa8738d tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499506 Jul 21 20:57:50.505488 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 290/564] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 20:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 20:57:50.516125 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b1e7ae21-6e27-40cc-a4d2-13d7f5807a45 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:50.516749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b1e7ae21-6e27-40cc-a4d2-13d7f5807a45 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:50.573317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b1e7ae21-6e27-40cc-a4d2-13d7f5807a45 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:50.581053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b1e7ae21-6e27-40cc-a4d2-13d7f5807a45 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1218 microversion: 2.1 time: 0.069297 Jul 21 20:57:50.581797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 275/565] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:50 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:51.271050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:51.271652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:51.278365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:51.278873 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:51.280293 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:51.280839 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:51.417908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:51.426624 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:51.428155 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:51.429302 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5f5eb12a-353f-4935-9469-4ae697db18b3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.162791 Jul 21 20:57:51.429865 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 291/566] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:51 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:51.599075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:51.599691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:51.606290 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:51.606742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:51.607569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:51.608562 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:51.670360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:51.677994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3ec62d7c-8e19-4744-a00d-530f337f4674 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1214 microversion: 2.1 time: 0.082773 Jul 21 20:57:51.678570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 276/567] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:51 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:52.449550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:52.450236 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:52.459121 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:52.460102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:52.461124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:52.461619 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:52.687402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:52.697284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:52.697796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:52.698977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:52.699690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:52.700909 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5c68589c-2dec-4a12-ad14-f88686f34c59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.255249 Jul 21 20:57:52.701852 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 292/568] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:52 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:52.707561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:52.708053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:52.708881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:52.709363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:52.775381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:52.784365 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c0ce0320-0c88-4f5d-8fc9-ad9aa7bb46b8 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1276 microversion: 2.1 time: 0.091088 Jul 21 20:57:52.785202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 277/569] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:52 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:57:53.720239 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:53.720951 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:53.727503 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:53.727990 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:53.728763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:53.729205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:53.801320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:53.802001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:53.809196 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:53.809643 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:53.810968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:53.811506 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:53.922354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:53.930274 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:53.932204 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:53.933373 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bff50ae3-f759-439a-a59f-374d55b605ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.217726 Jul 21 20:57:53.934115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 293/570] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:53 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:53.939774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-c3765708-5c17-46f7-bb5d-ba1555c3d20a req-9e4c10aa-b6c6-428d-9cd4-a4c44396799d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c964eee2-1da5-4818-9ac0-cba004ae767c", "tag": "1c6a3357-9332-4937-8334-c5bca326a13b"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:53.948265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-c3765708-5c17-46f7-bb5d-ba1555c3d20a req-9e4c10aa-b6c6-428d-9cd4-a4c44396799d service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:53.948707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-c3765708-5c17-46f7-bb5d-ba1555c3d20a req-9e4c10aa-b6c6-428d-9cd4-a4c44396799d service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:53.953344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:53.961557 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c0944b78-e46b-4ec5-bd0a-2ad168f47bf3 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.164088 Jul 21 20:57:53.962132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 278/571] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:53 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:57:53.962930 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-c3765708-5c17-46f7-bb5d-ba1555c3d20a req-9e4c10aa-b6c6-428d-9cd4-a4c44396799d service nova] Creating event network-changed:1c6a3357-9332-4937-8334-c5bca326a13b for instance c964eee2-1da5-4818-9ac0-cba004ae767c on hv-cinder-85068 Jul 21 20:57:53.968393 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-c3765708-5c17-46f7-bb5d-ba1555c3d20a req-9e4c10aa-b6c6-428d-9cd4-a4c44396799d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032854 Jul 21 20:57:53.968979 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 294/572] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:57:54.952676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:54.953299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:54.959683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:54.960158 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:54.960973 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:54.961409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:54.979246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:54.979980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:54.987005 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:54.987460 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:54.988259 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:54.988697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:55.096808 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:55.104789 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:55.106297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:55.107524 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9284b298-dac4-4441-862e-81240eb8456a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.158720 Jul 21 20:57:55.108120 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 279/573] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:54 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:57:55.120834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:55.128974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c53d73d6-53d5-42aa-884d-8bc33a6c5dd2 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.154346 Jul 21 20:57:55.129534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 295/574] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:54 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:57:56.129997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:56.131382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:56.137902 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:56.138348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:56.140777 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:56.141438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:56.145666 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:56.146824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:56.153247 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:56.153697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:56.154478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:56.154911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:56.285828 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:56.291568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:56.294328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:56.296529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:56.297741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-85e30046-60ec-499e-8f6d-4885444c8957 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.171618 Jul 21 20:57:56.298501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 280/575] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:56 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:56.300733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bed70bfa-2eee-4347-b924-a6179a3d8a2a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.158854 Jul 21 20:57:56.309974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 296/576] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:56 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:57:56.320568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-7ba67f8b-f103-47e3-af14-721c44358b81 req-e3e0ac77-1546-477b-95b4-42428ae434d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b1f12b-2ec1-4e9b-ac1b-61385f597069", "name": "network-vif-plugged", "status": "completed", "tag": "0a15578f-a527-4939-9a6b-ce6d94093a88"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:57:56.329045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-7ba67f8b-f103-47e3-af14-721c44358b81 req-e3e0ac77-1546-477b-95b4-42428ae434d4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:56.329493 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-7ba67f8b-f103-47e3-af14-721c44358b81 req-e3e0ac77-1546-477b-95b4-42428ae434d4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:56.340876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-7ba67f8b-f103-47e3-af14-721c44358b81 req-e3e0ac77-1546-477b-95b4-42428ae434d4 service nova] Creating event network-vif-plugged:0a15578f-a527-4939-9a6b-ce6d94093a88 for instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 on hv-cinder-85068 Jul 21 20:57:56.346858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-7ba67f8b-f103-47e3-af14-721c44358b81 req-e3e0ac77-1546-477b-95b4-42428ae434d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029867 Jul 21 20:57:56.347511 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 281/577] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:57:57.316793 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:57.317401 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:57.318353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:57.319054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:57.319849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:57.325223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:57.325400 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:57.325670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:57.325790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:57.326531 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:57.326708 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:57.326944 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:57.327050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:57.459444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:57.460686 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:57.468353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:57.469013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-76abc8af-7140-4188-b5fe-7405df8fb333 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.155284 Jul 21 20:57:57.469596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 282/578] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:57 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:57:57.469869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:57.471023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bbe23f24-49e8-4466-9595-fec83384823f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.158198 Jul 21 20:57:57.471576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 297/579] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:57 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:57:58.485949 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:58.486823 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:58.488988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:58.489494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:57:58.489589 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:58.494599 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:58.495051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:58.495860 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:58.495977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:58.496293 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:58.496407 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:58.497156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:58.497565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:58.627444 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:58.628048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:58.635158 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d01d66da-902a-401a-a008-38dbac7c18bf tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.153214 Jul 21 20:57:58.635770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 283/580] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:58 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:58.636187 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:58.637700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:58.639368 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b3253e16-e6d3-45c7-bdac-a2da63965669 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.153939 Jul 21 20:57:58.639946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 298/581] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:58 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:57:59.652518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:59.653259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:59.657609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:57:59.658219 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:57:59.659978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:59.660431 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:59.661198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:59.661643 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:59.664619 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:59.665064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:59.665831 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:57:59.666265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:57:59.793669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:59.794448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:59.802268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:59.802432 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-290c1017-8108-485b-9640-501b0ef9889f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.153816 Jul 21 20:57:59.803007 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 284/582] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:57:59 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:57:59.803805 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:57:59.804960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-24e63bf7-4a6f-4f06-bc99-b0cfe20cbc7d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.151456 Jul 21 20:57:59.805634 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 299/583] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:57:59 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:00.819167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:00.819810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:00.821729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:00.822178 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:00.822966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:00.826401 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:00.827341 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:00.828347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:00.828807 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:00.829849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:00.830298 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:00.832619 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:00.833071 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:00.833834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:00.834272 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:00.964328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:00.973607 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f1eec9bc-6502-44c2-8e8d-f3b93c45d3ee tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.158200 Jul 21 20:58:00.973811 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:00.974342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 285/584] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:00 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:00.981734 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:00.983760 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:00.984906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-510a3706-1e48-4d4b-b059-693b2ba9f548 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1743 microversion: 2.20 time: 0.166590 Jul 21 20:58:00.985450 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 300/585] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:00 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:01.991433 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:01.992077 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:01.999967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:02.000803 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:02.001647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:02.002306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:02.004154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:02.004777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:02.012029 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:02.014707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:02.015855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:02.016732 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:02.153290 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:02.164018 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7d7e413a-87ca-4aae-a6eb-0d928aa7027c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.176429 Jul 21 20:58:02.165981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 286/586] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:01 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:02.193241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:02.204311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:02.206092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:02.207486 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4444d99a-6b06-41b2-ba33-1721b3181269 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.207818 Jul 21 20:58:02.208079 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 301/587] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:01 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:02.989989 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-00f066be-393a-4093-b75d-9ac85e7d6dd4 req-685e7ba5-e0cb-4852-b36d-08efd73588a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c964eee2-1da5-4818-9ac0-cba004ae767c", "name": "network-vif-plugged", "status": "completed", "tag": "1c6a3357-9332-4937-8334-c5bca326a13b"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:03.001049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-00f066be-393a-4093-b75d-9ac85e7d6dd4 req-685e7ba5-e0cb-4852-b36d-08efd73588a3 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:03.001710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-00f066be-393a-4093-b75d-9ac85e7d6dd4 req-685e7ba5-e0cb-4852-b36d-08efd73588a3 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:03.019781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-00f066be-393a-4093-b75d-9ac85e7d6dd4 req-685e7ba5-e0cb-4852-b36d-08efd73588a3 service nova] Creating event network-vif-plugged:1c6a3357-9332-4937-8334-c5bca326a13b for instance c964eee2-1da5-4818-9ac0-cba004ae767c on hv-cinder-85068 Jul 21 20:58:03.027146 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-00f066be-393a-4093-b75d-9ac85e7d6dd4 req-685e7ba5-e0cb-4852-b36d-08efd73588a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042513 Jul 21 20:58:03.028572 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 287/588] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:58:03.183578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:03.184491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:03.193012 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:03.194360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:03.195529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:03.196431 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:03.226604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:03.227600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:03.241051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:03.243738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:03.244745 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:03.245631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:03.420812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:03.434063 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:03.436618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:03.438059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6a639f18-65dd-4533-b719-328a69482a7c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.215555 Jul 21 20:58:03.440059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 288/589] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:03 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:03.512196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:03.523745 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-809b41f3-022e-444b-b22f-87f84bf06bce tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.344921 Jul 21 20:58:03.524672 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 302/590] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:03 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:04.462341 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:04.463303 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:04.471227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:04.471835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:04.472931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:04.473536 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:04.541500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:04.542156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:04.549205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:04.549649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:04.550411 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:04.550842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:04.644981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:04.657175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:04.659492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:04.660689 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a7666240-ac08-4f72-9a71-c65f3624e76c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.202486 Jul 21 20:58:04.661435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 289/591] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:04 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:04.694668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:04.703685 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9b7624b5-e2a2-49e8-8c4f-e7baba05031f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.166691 Jul 21 20:58:04.704869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 303/592] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:04 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:58:05.680941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:05.681509 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:05.688640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:05.689099 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:05.690228 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:05.690679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:05.721802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:05.722517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:05.729374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:05.730104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:05.730962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:05.731462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:05.840043 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:05.849034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:05.850841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:05.852651 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7288d2fe-b684-4041-b10e-7f48401dde99 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.176711 Jul 21 20:58:05.864755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 290/593] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:05 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:05.883984 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:05.897701 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3c659e7d-57fc-4bee-b0de-c944a02e6724 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.179046 Jul 21 20:58:05.909902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 304/594] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:05 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:58:06.872006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:06.873611 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:06.880521 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:06.881060 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:06.881918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:06.882424 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:06.917596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:06.918958 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:06.927597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:06.928425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:06.929429 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:06.930231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:07.079628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:07.089536 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:07.093317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:07.095980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6ea168cf-ea7d-4463-bfd2-c0999ef30cfc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.227325 Jul 21 20:58:07.099804 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 291/595] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:06 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:07.100580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:07.110097 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8f190cf8-77d9-4b2b-911b-d07a59aacd6c tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1318 microversion: 2.1 time: 0.196178 Jul 21 20:58:07.110830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 305/596] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:06 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:58:08.115266 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:08.115915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:08.122489 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:08.123211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:08.124023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:08.124463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:08.127362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:08.128236 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:08.134881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:08.135405 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:08.136287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:08.136794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:08.269527 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:08.272210 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:08.282286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:08.283824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:08.288899 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-913884fe-f37e-445a-ad57-cb922684d8a1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.176896 Jul 21 20:58:08.290566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 292/597] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:08 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:08.298608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:08.301225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:08.309675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-59868cd4-3aaa-4342-9c17-43316862a1bc tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1505 microversion: 2.1 time: 0.186007 Jul 21 20:58:08.311311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 306/598] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:08 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:58:08.327558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-31a4b490-a998-4492-81be-41dd8765c63a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3889bac4-9a34-4fa9-be2f-026b444fb856", "device": "/dev/sdb"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:08.329224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-31a4b490-a998-4492-81be-41dd8765c63a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:08.335133 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-31a4b490-a998-4492-81be-41dd8765c63a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:08.335585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-31a4b490-a998-4492-81be-41dd8765c63a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:08.336384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-31a4b490-a998-4492-81be-41dd8765c63a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:08.336820 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-31a4b490-a998-4492-81be-41dd8765c63a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:08.629858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-31a4b490-a998-4492-81be-41dd8765c63a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "POST /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306471 Jul 21 20:58:08.631326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 293/599] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 20:58:08 2022] POST /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:58:09.309562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:09.310118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:09.317532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:09.317955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:09.318776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:09.319268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:09.479384 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:09.488881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:09.490779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:09.492488 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7c74009b-f1a8-467b-9ae9-467851546e38 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.187110 Jul 21 20:58:09.493360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 307/600] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:09 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:10.512238 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:10.513671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:10.520694 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:10.521132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:10.521901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:10.522331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:10.671992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:10.680975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:10.682477 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:10.683740 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a27d3167-f093-42b2-aa53-c0465b4eb84e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.175775 Jul 21 20:58:10.684560 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 294/601] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:10 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:11.703136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:11.703736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:11.710372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:11.710819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:11.711585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:11.712045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:11.857185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:11.870643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:11.875172 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:11.876801 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bcba1832-4222-41e1-b675-f224749ea597 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.178339 Jul 21 20:58:11.878508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 308/602] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:11 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:12.896717 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:12.897977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:12.905395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:12.905843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:12.906820 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:12.907498 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:13.047765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:13.057418 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:13.059276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:13.061067 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-402d2705-98cb-4fff-a0fe-0029b8d1d855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.167755 Jul 21 20:58:13.061712 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 295/603] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:12 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:14.079111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:14.079727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:14.086094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:14.086535 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:14.087284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:14.087729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:14.218152 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:14.226088 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:14.227522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:14.228698 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-769eb336-471b-41b9-80a9-a29d6acd0411 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1738 microversion: 2.20 time: 0.153455 Jul 21 20:58:14.229257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 309/604] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:14 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:15.248276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:15.248967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:15.255418 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:15.255895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:15.256653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:15.257085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:15.640349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:15.648143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:15.649638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:15.650781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f188b857-041c-4f03-b432-29962648682f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1720 microversion: 2.20 time: 0.406492 Jul 21 20:58:15.651350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 296/605] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:15 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1720 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:16.669160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:16.669769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:16.676503 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:16.676977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:16.677733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:16.678158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:16.805841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:16.814238 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:16.815791 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:16.816941 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-bffe1775-df47-46ab-b092-267ee194d6e9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1720 microversion: 2.20 time: 0.151688 Jul 21 20:58:16.817500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 310/606] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:16 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:16.967901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-0021b1ed-cd09-4e65-a119-469de81638e3 req-ecbc6b93-e687-4e85-aa63-7b8463a20947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b1f12b-2ec1-4e9b-ac1b-61385f597069", "name": "network-vif-unplugged", "status": "completed", "tag": "0a15578f-a527-4939-9a6b-ce6d94093a88"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:16.977645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-0021b1ed-cd09-4e65-a119-469de81638e3 req-ecbc6b93-e687-4e85-aa63-7b8463a20947 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:16.978313 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-0021b1ed-cd09-4e65-a119-469de81638e3 req-ecbc6b93-e687-4e85-aa63-7b8463a20947 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:16.990932 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-0021b1ed-cd09-4e65-a119-469de81638e3 req-ecbc6b93-e687-4e85-aa63-7b8463a20947 service nova] Creating event network-vif-unplugged:0a15578f-a527-4939-9a6b-ce6d94093a88 for instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 on hv-cinder-85068 Jul 21 20:58:16.996045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-0021b1ed-cd09-4e65-a119-469de81638e3 req-ecbc6b93-e687-4e85-aa63-7b8463a20947 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031972 Jul 21 20:58:16.996641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 297/607] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:58:17.835567 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:17.836224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:17.844089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:17.844540 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:17.845316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:17.845750 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:17.978830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:17.987892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:17.989402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:17.990552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-80fe0e6c-a80a-4f93-bc20-ccf2ecc961cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1720 microversion: 2.20 time: 0.158956 Jul 21 20:58:17.991107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 311/608] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:17 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:19.009601 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:19.010292 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:19.017937 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:19.018387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:19.019148 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:19.019590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:19.150187 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:19.158269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:19.159897 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:19.161060 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-879b9e5c-fd2e-4b4c-a8d0-68efc4d869d3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1720 microversion: 2.20 time: 0.155689 Jul 21 20:58:19.161632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 298/609] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:19 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:20.179013 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:20.179595 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:20.186354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:20.186790 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:20.187542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:20.187999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:20.314693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:20.322510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:20.324020 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:20.325160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a3fd3ee8-ecf8-485f-8768-bb4825edbd59 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1720 microversion: 2.20 time: 0.150033 Jul 21 20:58:20.325714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 312/610] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:20 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:21.345015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:21.345628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:21.352155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:21.352608 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:21.353372 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:21.353806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:21.491880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:21.500085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:21.501604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:21.502816 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3852873d-6014-4058-ba15-e0b7c390aed5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1720 microversion: 2.20 time: 0.162501 Jul 21 20:58:21.503600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 299/611] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:21 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:22.520806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:22.521402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:22.535847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:22.536296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:22.537091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:22.537562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:22.772823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:22.781222 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:22.782737 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:22.783930 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d10b9d8e-bcde-4419-9828-6b4eb221dde6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1663 microversion: 2.20 time: 0.267091 Jul 21 20:58:22.784487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 313/612] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:22 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1663 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:22.802529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0eaffde7-bf76-42eb-960f-e8a2b94a874b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ae7e24-22ef-4e30-998a-c8e8c6620307"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:22.803577 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0eaffde7-bf76-42eb-960f-e8a2b94a874b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:22.809968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0eaffde7-bf76-42eb-960f-e8a2b94a874b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:22.810446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0eaffde7-bf76-42eb-960f-e8a2b94a874b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:22.812274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0eaffde7-bf76-42eb-960f-e8a2b94a874b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:22.812716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0eaffde7-bf76-42eb-960f-e8a2b94a874b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:23.102611 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0eaffde7-bf76-42eb-960f-e8a2b94a874b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303770 Jul 21 20:58:23.103032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 300/613] 10.222.0.60 () {62 vars in 1363 bytes} [Thu Jul 21 20:58:22 2022] POST /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 20:58:23.217464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2e10b543-47f3-412b-86ab-8e0532ad8c43 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:23.218136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2e10b543-47f3-412b-86ab-8e0532ad8c43 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:23.224118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e10b543-47f3-412b-86ab-8e0532ad8c43 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:23.224567 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e10b543-47f3-412b-86ab-8e0532ad8c43 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:23.225324 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e10b543-47f3-412b-86ab-8e0532ad8c43 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:23.225757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e10b543-47f3-412b-86ab-8e0532ad8c43 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:23.318768 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2e10b543-47f3-412b-86ab-8e0532ad8c43 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/action" status: 202 len: 0 microversion: 2.20 time: 0.105970 Jul 21 20:58:23.319379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 314/614] 10.222.0.60 () {62 vars in 1318 bytes} [Thu Jul 21 20:58:23 2022] POST /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:58:23.328278 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:23.329017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:23.335869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:23.336398 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:23.337281 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:23.337747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:23.477317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:23.487163 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:23.488702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:23.489864 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e2411901-46b5-4ad0-b620-ae90db6ce121 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1749 microversion: 2.20 time: 0.166295 Jul 21 20:58:23.490465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 301/615] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:23 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:24.509321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:24.509934 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:24.517354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:24.517806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:24.518572 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:24.519011 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:24.645396 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:24.653718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:24.655485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:24.656653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8abf7456-2c78-4ac5-8d64-30bf82679160 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1749 microversion: 2.20 time: 0.151740 Jul 21 20:58:24.657208 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 315/616] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:24 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:25.675699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:25.676328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:25.682843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:25.683299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:25.684095 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:25.684538 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:25.816691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:25.825000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:25.827188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:25.828363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-08bdbb80-ca77-4033-b453-39cc5241bcd7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1749 microversion: 2.20 time: 0.156748 Jul 21 20:58:25.829049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 302/617] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:25 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:26.846679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:26.847292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:26.853779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:26.854225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:26.854991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:26.855426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:26.986747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:26.995345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:26.996876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:26.998727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e2e76851-916f-478b-841a-09abff53517f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1749 microversion: 2.20 time: 0.155292 Jul 21 20:58:26.999212 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 316/618] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:26 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:28.017033 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:28.017557 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:28.026421 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:28.026877 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:28.027664 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:28.028134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:28.161721 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:28.170085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:28.171736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:28.172891 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-21efec36-abb7-44f9-8afb-a140f7e3bd66 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1751 microversion: 2.20 time: 0.160488 Jul 21 20:58:28.173459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 303/619] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:28 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:28.982114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1fc20ea3-a64b-4626-9b4c-37f5b0b3c37d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:28.983246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1fc20ea3-a64b-4626-9b4c-37f5b0b3c37d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:28.985654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=42 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:28.991105 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1fc20ea3-a64b-4626-9b4c-37f5b0b3c37d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:28.991555 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1fc20ea3-a64b-4626-9b4c-37f5b0b3c37d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:28.992356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1fc20ea3-a64b-4626-9b4c-37f5b0b3c37d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:28.992794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1fc20ea3-a64b-4626-9b4c-37f5b0b3c37d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:29.015963 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1fc20ea3-a64b-4626-9b4c-37f5b0b3c37d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/ips" status: 200 len: 145 microversion: 2.1 time: 0.037585 Jul 21 20:58:29.016540 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 317/620] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 20:58:28 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:58:29.191452 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:29.192095 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:29.194513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=42 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:29.199851 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:29.200306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:29.201582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:29.202041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:29.343456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:29.353521 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:29.355451 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:29.356760 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-93da00b5-db66-4464-86b5-b5a028776f24 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1751 microversion: 2.20 time: 0.169246 Jul 21 20:58:29.357382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 304/621] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:29 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:30.376162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:30.376899 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:30.383564 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:30.384034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:30.384824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:30.385230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:30.805551 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:30.814633 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:30.816151 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:30.817301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5f552aac-3df5-4366-92f0-c92cce59d10e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.445370 Jul 21 20:58:30.817887 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 318/622] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:30 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:31.835970 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:31.836701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:31.843376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:31.843857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:31.844637 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:31.845076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:31.983703 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:31.992328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:31.993920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:31.995065 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cce72cd0-23b0-47df-b16d-7bc62f73b859 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.163538 Jul 21 20:58:31.995633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 305/623] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:31 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:32.139341 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:32.139897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:32.146705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:32.147175 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:32.148087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:32.148587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:32.234362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lazy-loading 'services' on Instance uuid c964eee2-1da5-4818-9ac0-cba004ae767c {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:58:32.312875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d2f55f06-610a-49a2-ae29-a0335e03bfba tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c/os-volume_attachments/3889bac4-9a34-4fa9-be2f-026b444fb856" status: 202 len: 0 microversion: 2.1 time: 0.177365 Jul 21 20:58:32.315854 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 319/624] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 20:58:32 2022] DELETE /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c/os-volume_attachments/3889bac4-9a34-4fa9-be2f-026b444fb856 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:58:33.015086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:33.015698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:33.022277 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:33.022723 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:33.023481 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:33.023949 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:33.026472 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:33.164374 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:33.173274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:33.174784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:33.175966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-85fd552b-7f32-4310-8351-bc1bb2a6c218 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.165488 Jul 21 20:58:33.176555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 306/625] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:33 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:33.472268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-86d2ed71-79f6-4549-b490-c724d8b0e1ae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1e2426e-5c06-484d-a3ea-2da712292d3f"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:33.473454 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-86d2ed71-79f6-4549-b490-c724d8b0e1ae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:33.479796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-86d2ed71-79f6-4549-b490-c724d8b0e1ae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:33.480240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-86d2ed71-79f6-4549-b490-c724d8b0e1ae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:33.480995 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-86d2ed71-79f6-4549-b490-c724d8b0e1ae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:33.481420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-86d2ed71-79f6-4549-b490-c724d8b0e1ae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:34.194453 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:34.195055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:34.202727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:34.203263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:34.204200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:34.204707 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:34.362810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:34.371979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:34.373675 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:34.374961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-afe5a823-1266-496a-bb39-19a21a810367 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.184435 Jul 21 20:58:34.375527 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 307/626] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:34 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:35.393329 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:35.394094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:35.400550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:35.401004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:35.401779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:35.402225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:35.540530 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:35.550371 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:35.552057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:35.553234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4d8fb201-014c-40cb-82fa-dd362c2daa9e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.163687 Jul 21 20:58:35.553658 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 308/627] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:35 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:36.573821 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:36.575704 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:36.585224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:36.585691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:36.586602 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:36.586903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:36.753081 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:36.761982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:36.764059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:36.765242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0ac26733-e270-42dc-9343-d160a5922cdc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.196854 Jul 21 20:58:36.765839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 309/628] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:36 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:37.784579 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:37.785415 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:37.791791 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:37.792249 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:37.793040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:37.793490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:37.938177 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:37.946812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:37.948401 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:37.949531 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c33f669e-041d-4750-b5ce-b82c0619cf44 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.169810 Jul 21 20:58:37.950249 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 310/629] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:37 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:38.968179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:38.968824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:38.976020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:38.976970 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:38.978515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:38.978982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:39.121182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:39.132058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:39.133665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:39.134965 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8707db4a-acb0-4154-8703-01aa0e20ac7f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.170749 Jul 21 20:58:39.135802 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 311/630] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:38 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:40.154653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:40.155410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:40.162252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:40.162765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:40.163552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:40.164026 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:40.311109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:40.319961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:40.321458 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:40.322618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2fe0cd00-756c-451d-83ac-dce27c412113 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.172059 Jul 21 20:58:40.323175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 312/631] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:40 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:41.340376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:41.341103 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:41.348701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:41.349153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:41.349933 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:41.350438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:41.493011 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:41.502659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:41.504175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:41.505327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-114d9a52-23fd-4aea-a8e2-45c5b4932ca1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.168939 Jul 21 20:58:41.505883 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 313/632] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:41 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:42.524109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:42.524817 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:42.531413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:42.531938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:42.532747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:42.533191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:42.665470 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:42.674831 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:42.676363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:42.677514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2d1e498f-d9fc-4ba9-bff4-e2fcd75a187b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.157309 Jul 21 20:58:42.678079 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 314/633] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:42 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:43.477947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=7 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:43.556406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:43.697213 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:43.697811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:43.704956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:43.705391 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:43.706142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:43.706572 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:43.834091 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:43.842507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:43.844039 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:43.845213 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a04a039a-3424-44ce-86f2-14585103c451 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.151914 Jul 21 20:58:43.845788 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 315/634] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:43 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:44.864420 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:44.865119 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:44.871645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:44.872139 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:44.872905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:44.873346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:45.003595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:45.011901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:45.013505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:45.014543 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f8860cf1-803a-4f18-a554-0f3e08199566 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.154861 Jul 21 20:58:45.015104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 316/635] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:44 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:46.032282 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:46.032953 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:46.039550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:46.040023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:46.040781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:46.041215 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:46.173940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:46.182876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:46.184422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:46.185575 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c1928d9c-bf34-4596-95b0-ffa8f04cef56 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.157128 Jul 21 20:58:46.186135 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 317/636] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:46 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:47.204510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:47.205144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:47.212226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:47.212679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:47.213439 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:47.213876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:47.343558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:47.352692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:47.354203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:47.355387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-20844e25-b148-4b9c-855b-99d7e5f5a774 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.154720 Jul 21 20:58:47.356004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 318/637] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:47 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:47.586238 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-86d2ed71-79f6-4549-b490-c724d8b0e1ae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.118791 Jul 21 20:58:47.587032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 320/638] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 20:58:33 2022] POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-volume_attachments => generated 194 bytes in 14121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:58:48.373968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:48.374582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:48.381304 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:48.381755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:48.382519 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:48.382957 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:48.518148 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:48.527190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:48.528720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:48.529879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-85988c17-6a6b-495e-a2d5-cbf09cec1952 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.159810 Jul 21 20:58:48.530977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 319/639] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:48 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:49.284882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:49.285508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:49.291681 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:49.292158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:49.292919 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:49.293354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:49.319903 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 20:58:49.394467 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d57bd701-7d58-4879-94d0-35c0d76b8ae0 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 204 len: 0 microversion: 2.1 time: 0.113739 Jul 21 20:58:49.394993 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 321/640] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 20:58:49 2022] DELETE /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 20:58:49.404798 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:49.405259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:49.411961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:49.412417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:49.413191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:49.413637 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:49.545569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:49.549613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:49.550315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:49.553589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-247786ae-3ed5-49e5-9739-8037c21112e9 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1511 microversion: 2.1 time: 0.153693 Jul 21 20:58:49.554385 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 320/641] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:49 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:49.557487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:49.557931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:49.558690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:49.559117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:49.688785 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:49.697252 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:49.698772 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:49.699961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a7334c49-aa2a-413b-8ced-24afe7df1423 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.154560 Jul 21 20:58:49.700520 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 322/642] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:49 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:50.571241 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:50.571869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:50.577855 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:50.578299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:50.579048 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:50.579478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:50.710791 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:50.718112 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:50.718597 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b6255d91-cbe2-4bfd-ac94-a0011504f87a tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1511 microversion: 2.1 time: 0.152025 Jul 21 20:58:50.718716 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:50.718927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 321/643] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:50 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:50.724946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:50.725383 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:50.726134 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:50.726561 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:50.858391 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:50.867637 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:50.869147 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:50.870280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b44affe2-6e01-45dc-ae25-caa2913debac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.155899 Jul 21 20:58:50.870824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 323/644] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:50 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:51.735002 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:51.735540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:51.742546 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:51.742988 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:51.743763 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:51.744198 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:51.880899 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:51.887024 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:51.889321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:51.889929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:51.890364 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-61f8ab59-3294-45ce-99f4-a40cb9b53056 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1511 microversion: 2.1 time: 0.158987 Jul 21 20:58:51.897827 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:51.898275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:51.899747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:51.899747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:51.901540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 322/645] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:51 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:52.108360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:52.117275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:52.118766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:52.119961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-720912fd-1fd1-4df9-9e60-981bc990e8cf tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.234525 Jul 21 20:58:52.120524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 324/646] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:51 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:52.401179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-4db9dd84-6d75-47ba-9e77-f6dbe04c0232 req-25ac74f1-8660-4aec-b7b2-e0656b8af3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c964eee2-1da5-4818-9ac0-cba004ae767c", "name": "network-vif-deleted", "tag": "1c6a3357-9332-4937-8334-c5bca326a13b"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:52.411296 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-4db9dd84-6d75-47ba-9e77-f6dbe04c0232 req-25ac74f1-8660-4aec-b7b2-e0656b8af3c4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:52.411917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-4db9dd84-6d75-47ba-9e77-f6dbe04c0232 req-25ac74f1-8660-4aec-b7b2-e0656b8af3c4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:52.431299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-4db9dd84-6d75-47ba-9e77-f6dbe04c0232 req-25ac74f1-8660-4aec-b7b2-e0656b8af3c4 service nova] Creating event network-vif-deleted:1c6a3357-9332-4937-8334-c5bca326a13b for instance c964eee2-1da5-4818-9ac0-cba004ae767c on hv-cinder-85068 Jul 21 20:58:52.438026 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-4db9dd84-6d75-47ba-9e77-f6dbe04c0232 req-25ac74f1-8660-4aec-b7b2-e0656b8af3c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110351 Jul 21 20:58:52.438602 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 323/647] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 20:58:52.908945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:52.909572 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:52.916879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:52.917317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:52.918529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:52.918529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:52.959782 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:52.960225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:52.960675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lazy-loading 'fault' on Instance uuid c964eee2-1da5-4818-9ac0-cba004ae767c {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:58:53.014538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:53.023676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4ad92ba9-d01e-40a7-93db-512a214b78c1 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1308 microversion: 2.1 time: 0.119253 Jul 21 20:58:53.024293 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 325/648] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:52 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:53.140150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:53.140867 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:53.148060 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:53.148516 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:53.149291 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:53.149729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:53.279328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:53.288544 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:53.290049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:53.291212 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d4394a16-1331-435d-9658-e21e18b3bb53 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.156281 Jul 21 20:58:53.291794 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 324/649] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:53 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:54.040538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:54.041152 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:54.047602 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:54.048080 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:54.048833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:54.049265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:54.079892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:54.080337 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:54.080780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lazy-loading 'fault' on Instance uuid c964eee2-1da5-4818-9ac0-cba004ae767c {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:58:54.121935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:54.131597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-14e30586-255b-4291-a141-a47b96eec75f tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1308 microversion: 2.1 time: 0.094903 Jul 21 20:58:54.132203 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 326/650] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:54 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:58:54.309873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:54.310428 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:54.317464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:54.317918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:54.318749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:54.319186 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:54.459818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:54.468330 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:54.469817 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:54.470964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-252df8c7-c29e-46f7-bc96-df5db9590358 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.165067 Jul 21 20:58:54.471529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 325/651] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:54 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:55.149752 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:55.150399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:55.156917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:55.157363 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:55.158116 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:55.158551 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:55.190361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:55.190805 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:55.191250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lazy-loading 'fault' on Instance uuid c964eee2-1da5-4818-9ac0-cba004ae767c {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:58:55.234130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc44212b992e4358bb37a1f8c4a6a77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e1d76644d94fd9ada9ff1ae3267bf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:55.242425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c961e917-bf97-4e2d-b54c-fafc289d0174 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 200 len: 1308 microversion: 2.1 time: 0.096644 Jul 21 20:58:55.242981 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 327/652] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:55 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:55.491532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:55.492134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:55.499360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:55.499838 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:55.500727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:55.501161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:55.635258 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:55.643639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:55.645150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:55.647301 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-61e357c5-5625-4336-9345-a269eff640f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.161038 Jul 21 20:58:55.647931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 326/653] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:55 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:56.146903 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8572bcab-aa9d-4c79-a96b-df971fe27990 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:56.153008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8572bcab-aa9d-4c79-a96b-df971fe27990 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:56.153579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8572bcab-aa9d-4c79-a96b-df971fe27990 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:56.215439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8572bcab-aa9d-4c79-a96b-df971fe27990 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Going to try to stop instance {{(pid=124646) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 20:58:56.259115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8572bcab-aa9d-4c79-a96b-df971fe27990 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action" status: 202 len: 0 microversion: 2.1 time: 0.115774 Jul 21 20:58:56.259857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:56.260029 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 328/654] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 20:58:56 2022] POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:58:56.264100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] [instance: c964eee2-1da5-4818-9ac0-cba004ae767c] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:56.269395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:56.269686 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:56.270429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:56.270891 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:56.271676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:56.272146 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:56.276344 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:56.276773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:56.277537 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:56.277970 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:56.286733 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] HTTP exception thrown: Instance c964eee2-1da5-4818-9ac0-cba004ae767c could not be found. Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Request method failure captured: Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c HTTP/1.1 Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b1MPKq_t87A9SaMu48yQVsgHXrzGK0OpvH4EkrAZvEDxszr5G5q1NLEauMU9jabNGNUO7ikuUY-oAsKq6IbigSn18mFOgbizGsEjyiWSBamIzP13XL8SlF-jPftld8rme8hsA7rsg6kdPZgD_MpLSw3fO4VB6Pi220vhJHawjdwqwM Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 98e1d76644d94fd9ada9ff1ae3267bf8 Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1159198546 Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 20:58:56.288387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98e1d76644d94fd9ada9ff1ae3267bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-VolumesSnapshotTestJSON-1159198546 Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 98e1d76644d94fd9ada9ff1ae3267bf8 Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1159198546 Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-VolumesSnapshotTestJSON-1159198546-project Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: cc44212b992e4358bb37a1f8c4a6a77c Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-VolumesSnapshotTestJSON-1159198546-project Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance c964eee2-1da5-4818-9ac0-cba004ae767c could not be found. Jul 21 20:58:56.289716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'c964eee2-1da5-4818-9ac0-cba004ae767c'} Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c964eee2-1da5-4818-9ac0-cba004ae767c could not be found. Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:58:56.290494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c964eee2-1da5-4818-9ac0-cba004ae767c could not be found. Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c964eee2-1da5-4818-9ac0-cba004ae767c could not be found. Jul 21 20:58:56.291768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 20:58:56.293004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] Returning 404 to user: Instance c964eee2-1da5-4818-9ac0-cba004ae767c could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:58:56.293004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-499f2a3d-b58d-4041-9364-81754de79315 tempest-VolumesSnapshotTestJSON-1159198546 tempest-VolumesSnapshotTestJSON-1159198546-project] 10.222.0.60 "GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c" status: 404 len: 111 microversion: 2.1 time: 0.033930 Jul 21 20:58:56.293004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 327/655] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:56 2022] GET /compute/v2.1/servers/c964eee2-1da5-4818-9ac0-cba004ae767c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 20:58:56.423759 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:56.432039 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-28a3cc56-4aa5-47ea-a7d1-bd517b2a6b3b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.166815 Jul 21 20:58:56.432606 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 329/656] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:56 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:58:56.665574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:56.666241 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:56.672632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:56.673073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:56.673821 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:56.674253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:56.806505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:56.814921 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:56.816482 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:56.817680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-15afa9f5-a37c-461a-9d48-95b3bb8f0ac2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.156000 Jul 21 20:58:56.818240 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 328/657] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:56 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:57.449815 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:57.450441 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:57.457159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:57.457607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:57.459200 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:57.459644 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:57.597405 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:57.615237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a0ecf93f-194b-4ba2-86f1-bd0c402b0630 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.168043 Jul 21 20:58:57.626801 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 330/658] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:57 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:57.837806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:57.838494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:57.844989 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:57.845392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:57.846238 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:57.846648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:57.989136 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:57.998504 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:58.000019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:58.001202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7afe7399-9319-4e12-8dcc-347f1e3aec6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.167415 Jul 21 20:58:58.012805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 329/659] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:57 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:58:58.030026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-4e7cefef-f472-449c-b26e-b9500d0a47d2 req-a94d1dd4-3b99-4a4c-bf99-3b26db6a052e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b1f12b-2ec1-4e9b-ac1b-61385f597069", "name": "network-vif-plugged", "status": "completed", "tag": "0a15578f-a527-4939-9a6b-ce6d94093a88"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:58:58.038550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-4e7cefef-f472-449c-b26e-b9500d0a47d2 req-a94d1dd4-3b99-4a4c-bf99-3b26db6a052e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:58.038983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-4e7cefef-f472-449c-b26e-b9500d0a47d2 req-a94d1dd4-3b99-4a4c-bf99-3b26db6a052e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:58.049587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-4e7cefef-f472-449c-b26e-b9500d0a47d2 req-a94d1dd4-3b99-4a4c-bf99-3b26db6a052e service nova] Creating event network-vif-plugged:0a15578f-a527-4939-9a6b-ce6d94093a88 for instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 on hv-cinder-85068 Jul 21 20:58:58.055074 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-4e7cefef-f472-449c-b26e-b9500d0a47d2 req-a94d1dd4-3b99-4a4c-bf99-3b26db6a052e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099198 Jul 21 20:58:58.055935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 331/660] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:58:58.632384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:58.633001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:58.639051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:58.639552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:58.640322 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:58.640762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:58.775439 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:58.783277 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7607e43d-60aa-4024-a943-558c7a4dc133 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.154813 Jul 21 20:58:58.783864 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 330/661] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:58 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:58:59.020868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:59.021462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:59.028146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:59.028592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:59.029352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:59.029786 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:59.163515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:59.171861 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:59.173365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:59.174507 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f227670c-1b13-4a90-b99a-28aec126162d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.158014 Jul 21 20:58:59.175067 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 332/662] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:58:59 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 20:58:59.800979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:58:59.801630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:58:59.804697 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=54 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:58:59.809915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:59.810369 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:59.811140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:58:59.811582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:58:59.939247 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:58:59.947815 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8bc1b36b-0c4d-411f-9677-b6dd77d40ba4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.150678 Jul 21 20:58:59.948380 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 331/663] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:58:59 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:00.193171 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:00.193779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:00.201159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:00.201605 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:00.202366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:00.202800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:00.206931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:59:00.333633 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:00.342835 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:00.344378 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:00.345532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4e99f95b-c91d-49b1-98f3-950ea164d524 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.156234 Jul 21 20:59:00.346089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 333/664] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:59:00 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:59:00.965447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:00.966060 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:00.972548 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:00.972996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:00.973751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:00.974185 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:01.103122 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:01.111070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-08e38f0c-9222-4202-92ad-3b6c9764e3ed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.149490 Jul 21 20:59:01.111641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 332/665] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:00 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:01.365122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:01.365641 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:01.372208 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:01.372677 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:01.373437 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:01.373863 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:01.509907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:01.518501 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:01.520076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:01.521251 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-05713772-f783-47e7-a64a-1e7ada87efce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.160424 Jul 21 20:59:01.521825 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 334/666] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:59:01 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:59:02.130258 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:02.130790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:02.138056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:02.138511 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:02.139291 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:02.139752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:02.281669 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:02.290570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fc704990-c722-464a-aa37-bf345161edf2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.164693 Jul 21 20:59:02.291137 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 333/667] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:02 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:02.540587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:02.541198 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:02.547566 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:02.548037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:02.548794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:02.549255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:02.681169 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:02.689829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:02.691402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:02.692765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5b376e1b-4ec4-4928-8852-785f8ae698d2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.156630 Jul 21 20:59:02.693325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 335/668] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:59:02 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:59:03.307401 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:03.308079 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:03.314471 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:03.314925 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:03.315689 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:03.316161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:03.448023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:03.456041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-99eea1df-9695-4fec-9c97-dfc1f0124966 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.152487 Jul 21 20:59:03.456619 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 334/669] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:03 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:59:03.711389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:03.711955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:03.718396 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:03.718844 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:03.719612 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:03.720076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:03.852068 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:03.860340 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:03.861830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:03.863226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3f678c75-e383-4ce4-a629-c45d4b8bd2e5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.156068 Jul 21 20:59:03.863796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 336/670] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:59:03 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:59:04.473995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:04.474600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:04.481670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:04.482114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:04.482896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:04.483329 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:04.615302 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:04.623451 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-314d9745-276d-4c66-9eb6-e7e703785bed tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.153215 Jul 21 20:59:04.624059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 335/671] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:04 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:04.882870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:04.883490 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:04.890150 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:04.890598 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:04.891374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:04.891839 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:05.030801 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:05.040284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:05.042263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:05.043487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2dbc3583-3543-42d4-b52e-002035aee157 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1807 microversion: 2.20 time: 0.165111 Jul 21 20:59:05.044367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 337/672] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:59:04 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:59:05.641308 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:05.641948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:05.648628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:05.649116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:05.649921 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:05.650519 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:05.798708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:05.807207 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8dd75e8a-326f-4ef4-ac18-b181b43ad9f1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.169957 Jul 21 20:59:05.807809 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 336/673] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:05 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:06.062625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:06.063162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:06.069921 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:06.070361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:06.071120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:06.071578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:06.219857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:06.228352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:06.229845 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:06.230989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c6692e24-9c2b-473c-ab6e-1a162f4bf1cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1794 microversion: 2.20 time: 0.172491 Jul 21 20:59:06.231548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 338/674] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 20:59:06 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 20:59:06.824559 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:06.825175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:06.831497 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:06.832081 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:06.832848 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:06.833283 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:06.977880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:06.986106 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-74376232-4852-4f88-a69b-141a30104174 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.165418 Jul 21 20:59:06.986679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 337/675] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:06 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:08.003253 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:08.003912 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:08.010585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:08.011165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:08.011978 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:08.012429 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:08.140308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:08.150374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-845edf97-584c-4f41-b2fb-cca212e15038 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.150747 Jul 21 20:59:08.150964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 339/676] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:07 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:09.168443 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:09.169057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:09.175885 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:09.176335 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:09.177096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:09.177721 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:09.308974 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:09.316849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-06f52450-321d-4882-85ea-6d7eac86a687 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.152239 Jul 21 20:59:09.317423 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 338/677] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:09 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:59:10.333947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:10.334584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:10.340984 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:10.341424 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:10.342177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:10.342609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:10.476668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:10.486711 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e5074f8d-ac14-4556-8f0e-8eb46dc166d2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.156565 Jul 21 20:59:10.487291 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 340/678] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:10 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:11.505152 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:11.505757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:11.512977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:11.513432 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:11.514190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:11.514727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:11.644835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:11.653835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-152c6650-a18e-4826-926f-a63105da9d8b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.152442 Jul 21 20:59:11.654347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 339/679] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:11 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:12.671776 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:12.672393 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:12.678875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:12.679325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:12.680175 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:12.680654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:12.809725 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:12.817842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dacd46a2-a2d4-4fb7-a111-6062ea0b1648 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.150049 Jul 21 20:59:12.818640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 341/680] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:12 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:13.836125 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:13.836738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:13.843269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:13.843749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:13.844514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:13.844954 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:13.979171 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:13.981396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:59:13.988858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-30d21a27-b1d1-4574-abc8-80db5e52ebae tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.156906 Jul 21 20:59:13.989435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 340/681] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:13 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:15.006069 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:15.006673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:15.009717 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:59:15.015159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:15.015608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:15.016397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:15.016832 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:15.151280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:15.159224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-df033e3d-5279-453c-8484-5c4b02025167 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.157060 Jul 21 20:59:15.159815 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 342/682] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:15 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:16.177216 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:16.177830 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:16.187174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:16.187623 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:16.188427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:16.188865 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:16.315456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:16.324357 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0bc20d3a-0455-42d4-905a-12ddcc9d959c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1724 microversion: 2.1 time: 0.151005 Jul 21 20:59:16.324931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 341/683] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:16 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:17.342004 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:17.342616 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:17.349139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:17.349591 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:17.350351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:17.350788 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:17.483231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:17.491416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d7307668-5b17-4e89-9dd0-2fdb07be9731 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1701 microversion: 2.1 time: 0.153287 Jul 21 20:59:17.492089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 343/684] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:17 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:17.508891 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-34fe2bd4-e489-4461-a6e2-8b5c248b514f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:59:17.515274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-34fe2bd4-e489-4461-a6e2-8b5c248b514f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:17.515740 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-34fe2bd4-e489-4461-a6e2-8b5c248b514f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:17.574941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-34fe2bd4-e489-4461-a6e2-8b5c248b514f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Going to try to start instance {{(pid=124647) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 20:59:17.618534 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-34fe2bd4-e489-4461-a6e2-8b5c248b514f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action" status: 202 len: 0 microversion: 2.1 time: 0.112555 Jul 21 20:59:17.619213 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 342/685] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 20:59:17 2022] POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 20:59:17.629898 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:17.630508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:17.637019 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:17.637709 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:17.639190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:17.639646 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:17.774607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:17.782994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-34fd34fe-c9b5-4913-8619-7acc64cfd151 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1710 microversion: 2.1 time: 0.156807 Jul 21 20:59:17.783579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 344/686] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:17 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:18.801843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:18.802555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:18.809340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:18.809793 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:18.810596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:18.811064 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:18.946789 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:18.954967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f7fa0da6-64ec-4020-8359-23bef4a3e8aa tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1710 microversion: 2.1 time: 0.157786 Jul 21 20:59:18.955526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 343/687] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:18 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:59:19.502866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e0a68237-fe9d-49fd-aebb-957ea7f58bd0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60baa75-e0dd-45b8-a4c9-d131e843f646"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:59:19.504115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e0a68237-fe9d-49fd-aebb-957ea7f58bd0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:19.510275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0a68237-fe9d-49fd-aebb-957ea7f58bd0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:19.510725 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0a68237-fe9d-49fd-aebb-957ea7f58bd0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:19.511492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0a68237-fe9d-49fd-aebb-957ea7f58bd0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:19.511972 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0a68237-fe9d-49fd-aebb-957ea7f58bd0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:19.971322 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:19.972008 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:19.978573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:19.979031 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:19.979839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:19.980283 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:20.117976 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:20.125975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bd2be751-4bc1-49be-8b4a-2f976e671179 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1714 microversion: 2.1 time: 0.158514 Jul 21 20:59:20.126560 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 344/688] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:19 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 20:59:20.292894 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e0a68237-fe9d-49fd-aebb-957ea7f58bd0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898044 Jul 21 20:59:20.293829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 345/689] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 20:59:19 2022] POST /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments => generated 194 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:59:24.536321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:59:24.536877 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Thu Jul 21 20:59:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:59:28.841562 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:59:28.842565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:28.849147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:28.849592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:28.850351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:28.850786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:28.874397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lazy-loading 'flavor' on Instance uuid 5ceb90ef-75ce-4b77-85a4-8441a15b41ce {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 20:59:29.035161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-af6c84f2-b6eb-457e-910a-a30fffd03477 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/action" status: 200 len: 32 microversion: 2.1 time: 0.197447 Jul 21 20:59:29.036065 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 345/690] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 20:59:28 2022] POST /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 20:59:29.046463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:29.047168 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:29.054676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:29.055409 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:29.056343 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:29.056826 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:29.279510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:29.287541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1887b3cb-71ec-4702-a15d-67140b2f109a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.245384 Jul 21 20:59:29.288137 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 346/691] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:29 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:30.306712 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:30.307318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:30.309781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=30 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:59:30.316426 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:30.316993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:30.317780 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:30.318223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:30.447211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:30.455057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f6fbe034-25a1-4cd0-aff6-7896e9b45f27 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.153215 Jul 21 20:59:30.455626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 346/692] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:30 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:31.472974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:31.473591 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:31.480313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:31.480759 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:31.481522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:31.481959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:31.484545 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:59:31.611904 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:31.620793 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fb707cc3-ac74-4157-8d7c-f1799bffe23b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.151647 Jul 21 20:59:31.621360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 347/693] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:31 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:32.638213 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:32.638827 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:32.645382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:32.645831 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:32.646598 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:32.647043 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:32.776864 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:32.784786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1bbfb2e7-42fd-4419-a048-21b61168e747 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.150441 Jul 21 20:59:32.785359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 347/694] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:32 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:33.801466 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:33.802101 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:33.808674 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:33.809115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:33.809869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:33.810299 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:33.943794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:33.952319 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cd75a788-bcb8-4b3b-bc4b-2638feecb327 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.154678 Jul 21 20:59:33.952879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 348/695] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:33 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:34.970152 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:34.970761 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:34.976952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:34.977396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:34.978152 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:34.978591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:35.110389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:35.118595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-07164606-949d-4d0f-b62c-59823a5b968c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.152310 Jul 21 20:59:35.119834 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 348/696] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:34 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:36.137479 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:36.138120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:36.144689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:36.145145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:36.145920 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:36.146364 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:36.277888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:36.285816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0f904634-0d30-4c19-bf51-cefef4d7d727 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.152879 Jul 21 20:59:36.286385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 349/697] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:36 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:37.302879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:37.303490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:37.310080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:37.310530 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:37.311289 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:37.311742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:37.440166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:37.448050 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f39905e1-ae0a-4e00-a932-a2cc09f6efea tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.148978 Jul 21 20:59:37.448882 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 349/698] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:37 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:38.465064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:38.465698 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:38.472083 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:38.472527 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:38.473276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:38.473704 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:38.604989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:38.613495 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e1a95225-2a75-4f34-b9a8-f3ce5909dc4c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.152108 Jul 21 20:59:38.614054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 350/699] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:38 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:39.345365 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 20:59:39.345902 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 20:59:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 20:59:39.630529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:39.631194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:39.638483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:39.638925 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:39.639682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:39.640144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:39.775155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:39.783284 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e56f9d66-55be-43d1-bb8c-746a77d21420 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.156723 Jul 21 20:59:39.783861 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 350/700] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:39 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:40.801141 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:40.801690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:40.808429 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:40.808881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:40.809651 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:40.810089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:40.944458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:40.952987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-43971359-0776-4d23-a716-522e036e1da5 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.155743 Jul 21 20:59:40.953555 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 351/701] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:40 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:41.969832 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:41.970482 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:41.977055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:41.977513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:41.978283 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:41.978726 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:42.108892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:42.117112 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5123e659-5552-4fa6-9c39-91801e53c8d6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.151249 Jul 21 20:59:42.117680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 351/702] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:41 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:43.134569 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:43.135183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:43.142727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:43.143173 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:43.143969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:43.144409 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:43.280564 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:43.288421 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b55e2836-c85b-4209-a133-c4ad8ce61ed7 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.157734 Jul 21 20:59:43.288979 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 352/703] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:43 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:44.305633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:44.306219 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:44.312706 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:44.313155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:44.313922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:44.314469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:44.444112 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:44.452575 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fa5e17f0-dea8-4426-ba0c-fd38768196ab tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.150901 Jul 21 20:59:44.453142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 352/704] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:44 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:45.470021 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:45.470632 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:45.473044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=22 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:59:45.478709 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:45.479150 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:45.480597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:45.481113 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:45.611050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:45.619222 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9dc5d4d4-536a-4b72-a177-15c05eecc9db tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.153039 Jul 21 20:59:45.619803 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 353/705] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:45 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:46.636191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:46.636801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:46.643255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:46.643698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:46.644478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:46.644909 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:46.647399 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 20:59:46.777069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:46.785225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c8cc066a-1db1-4a18-a3b8-1414b86456b3 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.152835 Jul 21 20:59:46.785799 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 353/706] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:46 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:47.803167 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:47.803738 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:47.811058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:47.811515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:47.812316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:47.812759 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:47.944819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:47.952881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-762a22b1-ee0c-4da1-a4d1-09b06fffdd30 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1736 microversion: 2.1 time: 0.153616 Jul 21 20:59:47.953444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 354/707] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:47 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:48.970087 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:48.970702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:48.977402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:48.977854 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:48.978623 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:48.979059 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:49.109110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:49.117385 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-91c71065-e7ad-4232-9005-7815f8160b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1716 microversion: 2.1 time: 0.151828 Jul 21 20:59:49.117955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 354/708] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:48 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:49.219101 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:49.219613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:49.226132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:49.226521 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:49.227284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:49.227732 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:49.308902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] HTTP exception thrown: Cannot 'detach_volume' instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce while it is in vm_state rescued Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Request method failure captured: Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments/f60baa75-e0dd-45b8-a4c9-d131e843f646 HTTP/1.1 Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byallxj-2zIOzbBTUsZ6s8zHDXiJcycfCm-0RzgZz8_G4ZMyQWr6DfdbRbtxCoixJ3bYreLJTWtQGm0RkxmhjqM0kKNO_2gNp_qaUH1qrUrvKQXuW63hJjKZSd_dyfntXJFzmOogi8eUrIpcMTbgiydWoSb1Njj36DS5PWyvRHgrus Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 20:59:49.311180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 24e4efb87cd34008a1b83c0ea0cce5aa Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 20:59:49.312830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Cannot 'detach_volume' instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce while it is in vm_state rescued Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'server_id': '5ceb90ef-75ce-4b77-85a4-8441a15b41ce', 'id': 'f60baa75-e0dd-45b8-a4c9-d131e843f646'} Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 20:59:49.313764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce while it is in vm_state rescued Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce while it is in vm_state rescued Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 20:59:49.315438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Returning 409 to user: Cannot 'detach_volume' instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce while it is in vm_state rescued {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 20:59:49.316823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-06703808-68a7-4588-be9f-0dc6c503ad63 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments/f60baa75-e0dd-45b8-a4c9-d131e843f646" status: 409 len: 152 microversion: 2.1 time: 0.097484 Jul 21 20:59:49.316823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 355/709] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 20:59:49 2022] DELETE /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments/f60baa75-e0dd-45b8-a4c9-d131e843f646 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 20:59:49.321549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c5e1ac60-5fcb-44a9-b8e6-b2a3a448dbbc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:59:49.322085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c5e1ac60-5fcb-44a9-b8e6-b2a3a448dbbc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:49.328709 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c5e1ac60-5fcb-44a9-b8e6-b2a3a448dbbc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:49.329163 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c5e1ac60-5fcb-44a9-b8e6-b2a3a448dbbc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:49.329930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c5e1ac60-5fcb-44a9-b8e6-b2a3a448dbbc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:49.330369 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c5e1ac60-5fcb-44a9-b8e6-b2a3a448dbbc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:49.395732 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c5e1ac60-5fcb-44a9-b8e6-b2a3a448dbbc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "POST /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/action" status: 202 len: 0 microversion: 2.1 time: 0.077803 Jul 21 20:59:49.396392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 355/710] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 20:59:49 2022] POST /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 20:59:49.409120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:49.409769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:49.416148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:49.417058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:49.417391 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:49.417808 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:49.632901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:49.640884 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7213872f-ebde-4536-9a0c-34d213cb9df8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1724 microversion: 2.1 time: 0.240236 Jul 21 20:59:49.641464 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 356/711] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:49 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:50.659285 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:50.659951 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:50.666720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:50.667167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:50.667976 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:50.668416 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:50.803179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:50.811658 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7bfe34c6-d053-499e-8d64-a7ff3e20838c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1724 microversion: 2.1 time: 0.156770 Jul 21 20:59:50.812252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 356/712] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:50 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:51.829404 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:51.830020 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:51.836572 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:51.837020 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:51.837780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:51.838217 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:51.972973 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:51.980814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a6967971-82a2-4bab-9267-3e0dc62dfd7c tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1724 microversion: 2.1 time: 0.155926 Jul 21 20:59:51.981368 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 357/713] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:51 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:52.997570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:52.998206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:53.004752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:53.005229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:53.005993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:53.006429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:53.135258 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 20:59:53.145110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-590c7181-042b-4a71-b2e2-c6760ab3e405 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1730 microversion: 2.1 time: 0.151278 Jul 21 20:59:53.145598 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 357/714] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 20:59:52 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 20:59:53.162628 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6ea6b653-8a7f-48b4-8e2e-7ef8f3ba46cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 20:59:53.163156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6ea6b653-8a7f-48b4-8e2e-7ef8f3ba46cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 20:59:53.170386 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6ea6b653-8a7f-48b4-8e2e-7ef8f3ba46cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:53.170824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6ea6b653-8a7f-48b4-8e2e-7ef8f3ba46cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:53.171581 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6ea6b653-8a7f-48b4-8e2e-7ef8f3ba46cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:53.172034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6ea6b653-8a7f-48b4-8e2e-7ef8f3ba46cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:53.250397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6ea6b653-8a7f-48b4-8e2e-7ef8f3ba46cc tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091679 Jul 21 20:59:53.250991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 358/715] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 20:59:53 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:59:54.335596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-553bdce7-e63f-4170-a6f6-2412fa5a7800 req-db93c20f-d61a-448a-8844-ab565c0ecdbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ceb90ef-75ce-4b77-85a4-8441a15b41ce", "tag": "e57d7145-76e9-4c5b-a742-c7da860acb28"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:59:54.345005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-553bdce7-e63f-4170-a6f6-2412fa5a7800 req-db93c20f-d61a-448a-8844-ab565c0ecdbc service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:54.345453 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-553bdce7-e63f-4170-a6f6-2412fa5a7800 req-db93c20f-d61a-448a-8844-ab565c0ecdbc service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:54.357853 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-553bdce7-e63f-4170-a6f6-2412fa5a7800 req-db93c20f-d61a-448a-8844-ab565c0ecdbc service nova] Creating event network-changed:e57d7145-76e9-4c5b-a742-c7da860acb28 for instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce on hv-cinder-85068 Jul 21 20:59:54.363120 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-553bdce7-e63f-4170-a6f6-2412fa5a7800 req-db93c20f-d61a-448a-8844-ab565c0ecdbc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031115 Jul 21 20:59:54.363979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 358/716] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 20:59:56.378013 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-fec7f4ff-8f3c-4f19-8fae-db14e39eae86 req-c000ef42-cbcd-4147-b10f-b446fe0b4a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ceb90ef-75ce-4b77-85a4-8441a15b41ce", "tag": "e57d7145-76e9-4c5b-a742-c7da860acb28"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 20:59:56.385956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-fec7f4ff-8f3c-4f19-8fae-db14e39eae86 req-c000ef42-cbcd-4147-b10f-b446fe0b4a6f service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 20:59:56.386400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-fec7f4ff-8f3c-4f19-8fae-db14e39eae86 req-c000ef42-cbcd-4147-b10f-b446fe0b4a6f service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 20:59:56.397857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-fec7f4ff-8f3c-4f19-8fae-db14e39eae86 req-c000ef42-cbcd-4147-b10f-b446fe0b4a6f service nova] Creating event network-changed:e57d7145-76e9-4c5b-a742-c7da860acb28 for instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce on hv-cinder-85068 Jul 21 20:59:56.403090 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-fec7f4ff-8f3c-4f19-8fae-db14e39eae86 req-c000ef42-cbcd-4147-b10f-b446fe0b4a6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029056 Jul 21 20:59:56.404546 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 359/717] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:00:13.678569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=25 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:13.679983 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:13.684568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a36dc70f-3ee7-467d-9688-c5be38f121ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:13.685140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a36dc70f-3ee7-467d-9688-c5be38f121ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:13.692678 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a36dc70f-3ee7-467d-9688-c5be38f121ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:13.693118 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a36dc70f-3ee7-467d-9688-c5be38f121ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:13.693876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a36dc70f-3ee7-467d-9688-c5be38f121ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:13.694304 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a36dc70f-3ee7-467d-9688-c5be38f121ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:13.725676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a36dc70f-3ee7-467d-9688-c5be38f121ea tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments/b0ae7e24-22ef-4e30-998a-c8e8c6620307" status: 200 len: 194 microversion: 2.20 time: 0.048806 Jul 21 21:00:13.726264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 359/718] 10.222.0.60 () {60 vars in 1453 bytes} [Thu Jul 21 21:00:13 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments/b0ae7e24-22ef-4e30-998a-c8e8c6620307 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:00:13.786267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=13 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:13.786991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=71 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:13.791508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:13.792109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:13.799431 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:13.799897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:13.800649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:13.801076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:13.885129 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lazy-loading 'services' on Instance uuid b6b1f12b-2ec1-4e9b-ac1b-61385f597069 {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:00:13.957517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-21e18e08-1ebc-4d93-9dda-009ad9be93fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments/b0ae7e24-22ef-4e30-998a-c8e8c6620307" status: 202 len: 0 microversion: 2.20 time: 0.172043 Jul 21 21:00:13.958652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 360/719] 10.222.0.60 () {60 vars in 1456 bytes} [Thu Jul 21 21:00:13 2022] DELETE /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments/b0ae7e24-22ef-4e30-998a-c8e8c6620307 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:00:13.966619 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-55190110-b1e0-481a-a26c-3bc4db0dbdd3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:13.968209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-55190110-b1e0-481a-a26c-3bc4db0dbdd3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:13.974929 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-55190110-b1e0-481a-a26c-3bc4db0dbdd3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:13.975442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-55190110-b1e0-481a-a26c-3bc4db0dbdd3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:13.976263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-55190110-b1e0-481a-a26c-3bc4db0dbdd3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:13.976718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-55190110-b1e0-481a-a26c-3bc4db0dbdd3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:14.006589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-55190110-b1e0-481a-a26c-3bc4db0dbdd3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043784 Jul 21 21:00:14.007149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 360/720] 10.222.0.60 () {60 vars in 1342 bytes} [Thu Jul 21 21:00:13 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:00:15.019590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f496a490-bae8-4891-ac91-55e9f64af368 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:15.020683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f496a490-bae8-4891-ac91-55e9f64af368 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:15.027202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f496a490-bae8-4891-ac91-55e9f64af368 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:15.027661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f496a490-bae8-4891-ac91-55e9f64af368 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:15.028450 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f496a490-bae8-4891-ac91-55e9f64af368 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:15.028893 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f496a490-bae8-4891-ac91-55e9f64af368 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:15.059534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f496a490-bae8-4891-ac91-55e9f64af368 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044732 Jul 21 21:00:15.060210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 361/721] 10.222.0.60 () {60 vars in 1342 bytes} [Thu Jul 21 21:00:15 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:00:16.072091 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e0dcb1d2-985b-40aa-8e87-2123351dab3e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:16.073011 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e0dcb1d2-985b-40aa-8e87-2123351dab3e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:16.080188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e0dcb1d2-985b-40aa-8e87-2123351dab3e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:16.080642 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e0dcb1d2-985b-40aa-8e87-2123351dab3e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:16.081410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e0dcb1d2-985b-40aa-8e87-2123351dab3e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:16.081849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e0dcb1d2-985b-40aa-8e87-2123351dab3e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:16.109632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e0dcb1d2-985b-40aa-8e87-2123351dab3e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041558 Jul 21 21:00:16.110195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 361/722] 10.222.0.60 () {60 vars in 1342 bytes} [Thu Jul 21 21:00:16 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:16.168469 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:16.168964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:16.175344 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:16.175821 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:16.176592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:16.177026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:16.205021 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:00:16.278288 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-acceefc8-48a0-4f61-8197-ff0b811d5485 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 204 len: 0 microversion: 2.20 time: 0.113394 Jul 21 21:00:16.278874 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 362/723] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Jul 21 21:00:16 2022] DELETE /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 21:00:16.288698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:16.289447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:16.295420 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:16.295916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:16.296663 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:16.297098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:16.431344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:16.439853 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:16.441347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:16.442500 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f5b2902a-bc25-4674-afd8-febbd48c3dab tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.158284 Jul 21 21:00:16.443057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 362/724] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:16 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:17.463434 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:17.464300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:17.472232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:17.472679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:17.473451 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:17.473884 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:17.604992 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:17.613338 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:17.615099 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:17.616294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b1ea09b3-d183-4a68-9567-dc0f41b46e2e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.157154 Jul 21 21:00:17.616858 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 363/725] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:17 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:18.635303 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:18.635944 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:18.643118 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:18.643569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:18.644370 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:18.644806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:18.771264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:18.779220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:18.780765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:18.781927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-29a42283-bbf5-49ce-ae87-2976e4188fd8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.150550 Jul 21 21:00:18.782498 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 363/726] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:18 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:19.800904 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:19.801770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:19.808493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:19.808960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:19.809722 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:19.810146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:20.024009 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:20.032542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:20.034061 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:20.035231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2b08c4f5-ba37-43e6-bb4e-79bf9fcc533c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 200 len: 1722 microversion: 2.20 time: 0.238295 Jul 21 21:00:20.035826 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 364/727] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:19 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:20.305776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-63568d60-d93c-4952-9847-70a392ed0546 req-94321c90-8b34-4c55-9f8f-c76f119f5187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b1f12b-2ec1-4e9b-ac1b-61385f597069", "name": "network-vif-deleted", "tag": "0a15578f-a527-4939-9a6b-ce6d94093a88"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:20.316098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-63568d60-d93c-4952-9847-70a392ed0546 req-94321c90-8b34-4c55-9f8f-c76f119f5187 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:20.316679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-63568d60-d93c-4952-9847-70a392ed0546 req-94321c90-8b34-4c55-9f8f-c76f119f5187 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:20.328698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-63568d60-d93c-4952-9847-70a392ed0546 req-94321c90-8b34-4c55-9f8f-c76f119f5187 service nova] Creating event network-vif-deleted:0a15578f-a527-4939-9a6b-ce6d94093a88 for instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 on hv-cinder-85068 Jul 21 21:00:20.335851 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-63568d60-d93c-4952-9847-70a392ed0546 req-94321c90-8b34-4c55-9f8f-c76f119f5187 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033656 Jul 21 21:00:20.337157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 364/728] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:00:21.054846 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:21.055287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:21.062770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:21.063214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:21.064014 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:21.064455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:21.079211 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] HTTP exception thrown: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Request method failure captured: Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 HTTP/1.1 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byb2VznJGGWOMZ3iy2W42fJKwACNx7Jknpc9V79qs6yqzGOanqSBdRwj--gaLUm-f_rD0C1hOTadmIeOIMStcsCHAVww2fxltqkkvAkxEwUsBjBU3vITJw0IyVq_5TNJnUgoDvWZoTOUrpzRl4K073dGgYVdLzw-F5IckwMVh07HV4 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:00:21.081139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 3a0d900f08d54098870ebbfa281e2a65 Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:00:21.082949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'b6b1f12b-2ec1-4e9b-ac1b-61385f597069'} Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:00:21.083943 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:00:21.085433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:00:21.086731 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Returning 404 to user: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:00:21.086731 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0a8bf3d3-2352-4b7f-a0df-0808c8521a82 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 404 len: 111 microversion: 2.20 time: 0.033825 Jul 21 21:00:21.090735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 365/729] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:21 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:00:21.097792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d28ba4af-5f7e-4556-a4cd-048201d362e1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '.version_select at 0x7f354018d790>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:21.128769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d28ba4af-5f7e-4556-a4cd-048201d362e1 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380704636" status: 204 len: 0 microversion: 2.20 time: 0.035425 Jul 21 21:00:21.129504 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 365/730] 10.222.0.60 () {60 vars in 1261 bytes} [Thu Jul 21 21:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380704636 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 21:00:21.899048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4a326f37-68ee-44a5-baad-25f9945b717e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'create', calling method: .version_select at 0x7f35401c9ca0>, body: {"keypair": {"name": "tempest-keypair-1614896864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDGSZcSZE8QsbVe7fH3+t3yHg+wnnFxL8JZuQn7+5SxFJ0cCrx7kdTxH31gHbdHJIQ+HuGr1w44OwRcoEp4iKvtZ58tpkBTPBYyAv0WLdyT84mpqGN+Oy9ohnaaOjwgsQ=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:21.913090 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-4a326f37-68ee-44a5-baad-25f9945b717e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:00:21.916949 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-4a326f37-68ee-44a5-baad-25f9945b717e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for user 3a0d900f08d54098870ebbfa281e2a65 and project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:00:21.944667 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4a326f37-68ee-44a5-baad-25f9945b717e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049737 Jul 21 21:00:21.945652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 366/731] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Jul 21 21:00:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 21:00:23.329205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1544979907", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b37db4ce-f6bd-42a4-9277-6fc954d54178"}], "security_groups": [{"name": "tempest-securitygroup--871271966"}], "key_name": "tempest-keypair-1614896864", "user_data": "}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:23.432192 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] validate_networks() for [('b37db4ce-f6bd-42a4-9277-6fc954d54178', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:00:23.917782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:00:23.918211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:00:23.918683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:00:23.919087 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:00:23.919498 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:00:23.928817 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:23.929262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:23.930055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:23.930491 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:23.949359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:00:23.953454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Getting quotas for user 3a0d900f08d54098870ebbfa281e2a65 and project c312164b3fdd40719fcdd94ed6bfd187. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:00:23.964292 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:00:23.966529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:00:24.015304 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8ae8ef51-5b8b-4e86-9ed2-62d6fc2bbd5a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.691230 Jul 21 21:00:24.015990 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 366/732] 10.222.0.60 () {62 vars in 1187 bytes} [Thu Jul 21 21:00:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 21:00:24.028064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a91e816e-c684-4aec-868d-30bf602bb003 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:24.028670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a91e816e-c684-4aec-868d-30bf602bb003 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:24.090531 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a91e816e-c684-4aec-868d-30bf602bb003 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:24.098072 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a91e816e-c684-4aec-868d-30bf602bb003 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:24.099686 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a91e816e-c684-4aec-868d-30bf602bb003 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:24.100888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a91e816e-c684-4aec-868d-30bf602bb003 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1282 microversion: 2.20 time: 0.077697 Jul 21 21:00:24.101516 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 367/733] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:24 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:25.120593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:25.121212 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:25.127947 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:25.128394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:25.129147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:25.129578 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:25.199321 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:25.208470 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:25.210010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:25.211106 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f7ffaf45-40e9-46a7-82ce-6325389d90aa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1342 microversion: 2.20 time: 0.095153 Jul 21 21:00:25.211882 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 367/734] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:25 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:26.230154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:26.230792 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:26.237661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:26.238186 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:26.239236 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:26.239683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:26.451548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:26.459811 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:26.461349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:26.462471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-79618031-8a98-470c-a74d-83a63b956e0a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.236286 Jul 21 21:00:26.463349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 368/735] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:26 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:26.767869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-bc303d05-a136-4174-b802-2e5fcccb212d req-0f0ae171-9e0f-47f2-a1db-adf1cc2da26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4fa343-16d7-4f75-a3e3-3abef4456ed6", "tag": "4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:26.777314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-bc303d05-a136-4174-b802-2e5fcccb212d req-0f0ae171-9e0f-47f2-a1db-adf1cc2da26b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:26.778010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-bc303d05-a136-4174-b802-2e5fcccb212d req-0f0ae171-9e0f-47f2-a1db-adf1cc2da26b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:26.796686 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-bc303d05-a136-4174-b802-2e5fcccb212d req-0f0ae171-9e0f-47f2-a1db-adf1cc2da26b service nova] Creating event network-changed:4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8 for instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 on hv-cinder-85068 Jul 21 21:00:26.801984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-bc303d05-a136-4174-b802-2e5fcccb212d req-0f0ae171-9e0f-47f2-a1db-adf1cc2da26b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040297 Jul 21 21:00:26.802630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 368/736] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:00:27.481321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:27.481946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:27.489921 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:27.490354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:27.491124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:27.491558 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:27.632646 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:27.643212 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:27.644746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:27.645859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8285e5a0-2cf6-46e5-921f-bc6f0ee06585 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.168525 Jul 21 21:00:27.646448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 369/737] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:27 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:27.700631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:27.701256 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:27.707792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:27.708244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:27.709005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:27.709443 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:27.836226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lazy-loading 'services' on Instance uuid 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:00:27.950834 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-576e82ac-92e8-47bd-abfc-c99c432ebc1d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-volume_attachments/b1e2426e-5c06-484d-a3ea-2da712292d3f" status: 202 len: 0 microversion: 2.1 time: 0.460853 Jul 21 21:00:27.951990 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 369/738] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:00:27 2022] DELETE /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-volume_attachments/b1e2426e-5c06-484d-a3ea-2da712292d3f => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 21:00:28.663850 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:28.664384 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:28.671517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:28.671967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:28.672723 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:28.673153 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:28.803473 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:28.811278 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:28.812789 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:28.813883 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0ff96408-ef18-4aac-922b-11cfefd31eac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.154073 Jul 21 21:00:28.814425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 370/739] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:28 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:29.833488 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:29.834190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:29.840558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:29.841012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:29.841776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:29.842792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:29.978984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:29.986964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:29.988506 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:29.989873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2dd50e6f-6de7-4164-a050-762725fe02ac tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.161213 Jul 21 21:00:29.990443 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 370/740] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:29 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:31.008332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:31.008933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:31.015183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:31.015624 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:31.016410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:31.016836 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:31.153054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:31.161594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:31.163308 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:31.164281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a3426e3f-4752-486d-a527-ac88e9828da7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.160728 Jul 21 21:00:31.164828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 371/741] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:31 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:32.181381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:32.182088 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:32.189087 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:32.189474 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:32.190244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:32.190680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:32.229522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fec3acd8-cf87-419a-b27e-4b88b4ceb7db tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:32.237066 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fec3acd8-cf87-419a-b27e-4b88b4ceb7db tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:32.237512 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fec3acd8-cf87-419a-b27e-4b88b4ceb7db tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:32.261584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fec3acd8-cf87-419a-b27e-4b88b4ceb7db tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Going to try to stop instance {{(pid=124646) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 21:00:32.310248 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fec3acd8-cf87-419a-b27e-4b88b4ceb7db tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action" status: 202 len: 0 microversion: 2.1 time: 0.083888 Jul 21 21:00:32.312110 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 372/742] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 21:00:32 2022] POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 21:00:32.320942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:32.321751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:32.331786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:32.332960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:32.333428 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:32.334225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:32.334880 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:32.343701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:32.345221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:32.346338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0f206d4d-007e-40af-a51f-9ac9c4b5c6fe tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.168764 Jul 21 21:00:32.346914 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 371/743] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:32 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:32.480765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:32.488872 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b18920a0-ad24-4ef7-b2fd-55cdc93ebe41 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.172461 Jul 21 21:00:32.489727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 373/744] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:32 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:00:33.364718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:33.365334 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:33.371835 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:33.372292 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:33.373070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:33.373649 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:33.503821 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:33.507987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:33.508603 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:33.511800 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:33.513305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:33.514452 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ecb62bc5-547a-4ad1-b05b-b894b55794fb tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.153974 Jul 21 21:00:33.515077 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:33.515209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 372/745] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:33 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:33.515530 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:33.516408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:33.516859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:33.645728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:33.653233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-120e4f01-049a-4f6f-8375-6c2dd29904c7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.149007 Jul 21 21:00:33.653797 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 374/746] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:33 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:00:34.412495 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-6e248e9c-ba17-4bd3-b7a9-4c51b5027a53 req-7a4d2983-7ea0-48fa-abc2-4db1a65f1d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4fa343-16d7-4f75-a3e3-3abef4456ed6", "name": "network-vif-plugged", "status": "completed", "tag": "4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:34.421322 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:34.422568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:34.431158 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-6e248e9c-ba17-4bd3-b7a9-4c51b5027a53 req-7a4d2983-7ea0-48fa-abc2-4db1a65f1d2d service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:34.432104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-6e248e9c-ba17-4bd3-b7a9-4c51b5027a53 req-7a4d2983-7ea0-48fa-abc2-4db1a65f1d2d service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:34.444525 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-6e248e9c-ba17-4bd3-b7a9-4c51b5027a53 req-7a4d2983-7ea0-48fa-abc2-4db1a65f1d2d service nova] Creating event network-vif-plugged:4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8 for instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 on hv-cinder-85068 Jul 21 21:00:34.449785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-6e248e9c-ba17-4bd3-b7a9-4c51b5027a53 req-7a4d2983-7ea0-48fa-abc2-4db1a65f1d2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046853 Jul 21 21:00:34.450974 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 373/747] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:00:34.533348 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:34.533970 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:34.536051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:34.541791 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:34.542241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:34.543018 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:34.543458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:34.671409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:34.672158 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:34.678397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:34.678849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:34.679618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:34.680084 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:34.716124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:34.720939 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:34.727743 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:34.729406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:34.730533 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-11ce166c-e0a9-4ec8-9d31-16796a20178e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.201850 Jul 21 21:00:34.731095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 375/748] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:34 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:34.817201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:34.824560 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-57ddf4ed-b68d-4de8-a3a6-3ab76c0ce855 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.157868 Jul 21 21:00:34.825131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 374/749] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:34 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:00:35.749601 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:35.750211 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:35.758040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:35.758485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:35.759247 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:35.759682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:35.842785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:35.843408 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:35.849568 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:35.850026 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:35.850796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:35.851239 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:35.892588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:35.900741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:35.902257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:35.903367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-62089dcb-9d70-4dc3-babf-576bd257120e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.157870 Jul 21 21:00:35.903950 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 376/750] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:35 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:35.980209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:35.987560 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7b1deb58-5056-417c-b4da-ec72e996cd27 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.149668 Jul 21 21:00:35.988395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 375/751] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:35 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:00:36.922528 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:36.923078 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:36.929499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:36.929939 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:36.930692 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:36.931121 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:37.005584 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:37.006433 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:37.013075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:37.013595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:37.014433 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:37.015055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:37.063372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:37.071270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:37.072796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:37.073897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-33d59c9e-5fe9-4eb4-915e-534cbc40d9e4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1407 microversion: 2.20 time: 0.155852 Jul 21 21:00:37.074458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 377/752] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:36 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:37.146157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:37.153654 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0b498042-b24c-4fd0-8ee2-14c167bdc699 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.151933 Jul 21 21:00:37.154232 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 376/753] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:37 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:38.091927 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:38.092653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:38.099095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:38.099535 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:38.100314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:38.100746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:38.170847 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:38.171433 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:38.177882 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:38.178299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:38.179100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:38.179475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:38.234295 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:38.242693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:38.244228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:38.245379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4fca995c-99d5-419b-bf76-429928b14d5f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1598 microversion: 2.20 time: 0.157409 Jul 21 21:00:38.245935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 378/754] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:00:38 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:00:38.263207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ee905ac2-5556-4acc-8aea-438eeaa77c8e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:38.264233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ee905ac2-5556-4acc-8aea-438eeaa77c8e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:38.270437 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ee905ac2-5556-4acc-8aea-438eeaa77c8e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:38.270881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ee905ac2-5556-4acc-8aea-438eeaa77c8e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:38.271649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ee905ac2-5556-4acc-8aea-438eeaa77c8e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:38.272112 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ee905ac2-5556-4acc-8aea-438eeaa77c8e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:38.313579 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:38.321222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0da1f37c-977f-499e-b31e-c873775deb95 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.154648 Jul 21 21:00:38.321797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 377/755] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:38 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:00:38.348928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ee905ac2-5556-4acc-8aea-438eeaa77c8e tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089399 Jul 21 21:00:38.349525 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 379/756] 10.222.0.60 () {60 vars in 1315 bytes} [Thu Jul 21 21:00:38 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 21:00:39.338296 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:39.338888 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:39.346166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:39.346617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:39.347391 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:39.347860 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:39.367078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:39.486468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:39.494677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1b395536-ef75-4bf0-87f9-dbf0ce435c52 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.160204 Jul 21 21:00:39.505757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 378/757] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:39 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:39.512126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-8e7185f7-376a-4c0c-a94e-3dd7707e6b23 req-b424f7d8-ed45-46c0-abbb-db650fdc3de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4fa343-16d7-4f75-a3e3-3abef4456ed6", "tag": "4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:39.520838 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-8e7185f7-376a-4c0c-a94e-3dd7707e6b23 req-b424f7d8-ed45-46c0-abbb-db650fdc3de1 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:39.521284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-8e7185f7-376a-4c0c-a94e-3dd7707e6b23 req-b424f7d8-ed45-46c0-abbb-db650fdc3de1 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:39.533828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-8e7185f7-376a-4c0c-a94e-3dd7707e6b23 req-b424f7d8-ed45-46c0-abbb-db650fdc3de1 service nova] Creating event network-changed:4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8 for instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 on hv-cinder-85068 Jul 21 21:00:39.539519 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-8e7185f7-376a-4c0c-a94e-3dd7707e6b23 req-b424f7d8-ed45-46c0-abbb-db650fdc3de1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031215 Jul 21 21:00:39.540128 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 380/758] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:00:40.513145 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:40.513826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:40.520444 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:40.520900 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:40.521689 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:40.522131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:40.651317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:40.659747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8ffb378e-da9d-4852-8942-f8c1758c8634 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.150365 Jul 21 21:00:40.660315 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 379/759] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:40 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:41.678483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:41.679181 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:41.685360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:41.685911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:41.686683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:41.687119 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:41.814880 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:41.822462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-462aff16-26e1-4870-b872-a6f63bbc8c84 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.148617 Jul 21 21:00:41.823028 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 381/760] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:41 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:42.839778 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:42.840387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:42.847088 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:42.847476 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:42.848254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:42.848716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:42.980117 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:42.988036 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bc9e1f53-2fe3-4a4d-b047-03d127c8b75c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.152064 Jul 21 21:00:42.988611 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 380/761] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:42 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:44.005688 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:44.006335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:44.008834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:44.014679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:44.015132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:44.015923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:44.016365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:44.150849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:44.158437 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-78bda309-fca3-472a-b25c-c7a70f5a13a8 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.156582 Jul 21 21:00:44.159002 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 382/762] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:44 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:45.175331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:45.176068 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:45.178525 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:45.183814 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:45.184269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:45.185040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:45.185485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:45.322314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:45.330578 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-516af098-f089-4003-9a76-2fdf29d1be42 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.159101 Jul 21 21:00:45.331152 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 381/763] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:45 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:46.348397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:46.349013 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:46.356069 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:46.356522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:46.357297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:46.358557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:46.491147 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:46.498623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-183869db-bbb2-48ec-a0ea-3516d9611117 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.154059 Jul 21 21:00:46.499220 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 383/764] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:46 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:00:47.516136 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:47.516756 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:47.523190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:47.523644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:47.524457 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:47.524897 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:47.655729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:47.663072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1c615a82-cc3a-44dc-bed7-48a44b5f45fc tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.150843 Jul 21 21:00:47.663647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 382/765] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:47 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:48.681451 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:48.681984 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:48.689182 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:48.689630 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:48.690415 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:48.690854 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:48.822272 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:48.829750 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dcb228c5-88bc-4fc8-a918-88003d6d1017 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.152212 Jul 21 21:00:48.830316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 384/766] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:48 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:49.846850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:49.847460 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:49.853974 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:49.854429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:49.855191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:49.855629 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:49.988242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:49.996085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2a76000c-7e38-49de-8c59-2dc809f99a28 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.153046 Jul 21 21:00:49.996655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 383/767] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:49 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:51.014388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:51.015082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:51.021537 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:51.021985 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:51.022748 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:51.023177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:51.155220 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:51.162749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2c5c3f8a-e4e7-40f9-b184-71d2e89afde2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.152765 Jul 21 21:00:51.163302 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 385/768] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:51 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:51.878001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:51.878602 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:51.884899 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:51.885355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:51.886113 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:51.886548 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:51.910425 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Going to try to terminate instance {{(pid=124647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:00:51.985280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4d13a613-a64a-4bec-94c6-0c99f6d85a79 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "DELETE /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 204 len: 0 microversion: 2.1 time: 0.111636 Jul 21 21:00:51.986070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 384/769] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:00:51 2022] DELETE /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:00:51.994804 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:51.995482 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:52.002490 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:52.002935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:52.003690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:52.004151 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:52.136094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:52.143670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-809564ae-8743-4569-b4f5-a7b8f98669d7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1576 microversion: 2.1 time: 0.152851 Jul 21 21:00:52.144268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 386/770] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:51 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:52.180561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:52.181259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:52.187318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:52.187774 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:52.188540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:52.189648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:52.318243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:52.325768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6cb9b5c7-2889-477a-a14f-4d56ef4100bd tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.149459 Jul 21 21:00:52.326345 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 385/771] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:52 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:53.161548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:53.162159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:53.168818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:53.169262 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:53.170611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:53.171075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:53.308830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:53.317496 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a9e6c809-d64a-4545-af88-b3089ecfb0f3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1576 microversion: 2.1 time: 0.159770 Jul 21 21:00:53.318072 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 387/772] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:53 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:53.344920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:53.345953 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:53.353073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:53.353528 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:53.354880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:53.354880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:53.509585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:53.518596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-94502266-b22d-4f85-832c-7a2b8198e9f6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1678 microversion: 2.1 time: 0.179628 Jul 21 21:00:53.519180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 386/773] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:53 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:54.334395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:54.335191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:54.341941 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:54.342389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:54.343413 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:54.343894 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:54.536546 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:54.537267 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:54.543643 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:54.544121 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:54.544946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:54.545605 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:54.573480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:54.583148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-111ddbe3-8a3c-4b0a-8a49-382024508e53 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1576 microversion: 2.1 time: 0.252536 Jul 21 21:00:54.590697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 388/774] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:54 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1576 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:54.676463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:54.683979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3285954e-39bb-442b-902c-d930e4f636c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1655 microversion: 2.1 time: 0.151229 Jul 21 21:00:54.684750 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 387/775] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:54 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:00:54.700919 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f85e2f39-4eef-4720-adbd-e88be551b2d6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:54.707099 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f85e2f39-4eef-4720-adbd-e88be551b2d6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:54.707549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f85e2f39-4eef-4720-adbd-e88be551b2d6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:54.729715 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f85e2f39-4eef-4720-adbd-e88be551b2d6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Going to try to start instance {{(pid=124646) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 21:00:54.774879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f85e2f39-4eef-4720-adbd-e88be551b2d6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action" status: 202 len: 0 microversion: 2.1 time: 0.077284 Jul 21 21:00:54.775494 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 389/776] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 21:00:54 2022] POST /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 21:00:54.784862 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:54.785881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:54.792686 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:54.793353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:54.794691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:54.794691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:54.944320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:54.952002 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1fa9da66-e070-4e1c-b698-616135c71287 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1664 microversion: 2.1 time: 0.172022 Jul 21 21:00:54.952577 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 388/777] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:54 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:55.430390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-34f81c05-c551-49a5-aac0-c41ede145e79 req-5f117efd-ed53-4324-b5d7-eb97097a783a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528c37e5-c939-4326-bb37-7b63c853560d", "name": "network-vif-deleted", "tag": "3456dc7f-b173-4681-b12b-4f70ac0bfa5e"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:55.441102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-34f81c05-c551-49a5-aac0-c41ede145e79 req-5f117efd-ed53-4324-b5d7-eb97097a783a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:55.441578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-34f81c05-c551-49a5-aac0-c41ede145e79 req-5f117efd-ed53-4324-b5d7-eb97097a783a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:55.454180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-34f81c05-c551-49a5-aac0-c41ede145e79 req-5f117efd-ed53-4324-b5d7-eb97097a783a service nova] Creating event network-vif-deleted:3456dc7f-b173-4681-b12b-4f70ac0bfa5e for instance 528c37e5-c939-4326-bb37-7b63c853560d on hv-cinder-85068 Jul 21 21:00:55.459630 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-34f81c05-c551-49a5-aac0-c41ede145e79 req-5f117efd-ed53-4324-b5d7-eb97097a783a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033396 Jul 21 21:00:55.460891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 390/778] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:00:55.600349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:55.601137 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:55.608838 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:55.610194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:55.611175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:55.612160 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:55.681672 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:55.690325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ec58e485-fc83-463d-a97c-4accbb2be02e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1225 microversion: 2.1 time: 0.093701 Jul 21 21:00:55.699111 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 389/779] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:55 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:55.974488 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:55.975467 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:55.982140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:55.983320 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:55.984326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:55.984764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:56.122515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:56.130402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1ab8fc32-909f-4029-b7b7-0e581f41f949 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1664 microversion: 2.1 time: 0.160223 Jul 21 21:00:56.139947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 391/780] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:55 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:56.706939 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:56.707543 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:56.714031 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:56.714475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:56.715276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:56.715654 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:56.746499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:56.746942 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:56.747379 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lazy-loading 'fault' on Instance uuid 528c37e5-c939-4326-bb37-7b63c853560d {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:00:56.788098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:56.795387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fd56009c-492b-4464-8631-e2cc2b8fc1fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 200 len: 1230 microversion: 2.1 time: 0.092310 Jul 21 21:00:56.795977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 390/781] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:56 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:57.148326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:57.148957 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:57.155457 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:57.155931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:57.156684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:57.157117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:57.283619 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:57.291096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-74e40037-7e3a-4203-85ed-af06ab58fc5a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1668 microversion: 2.1 time: 0.146591 Jul 21 21:00:57.291649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 392/782] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:57 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:00:57.813055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:57.813652 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:57.820159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:57.820603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:57.821357 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:57.821785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:57.835000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] HTTP exception thrown: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Request method failure captured: Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d HTTP/1.1 Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b1r1hcyiSTWwswaD4oU87V_Ol743LFKzlceCa4YCWBJVV_5Bi6q9FzRaucZCGkXv8NjYTjG5BexJOqymLeRU6ElWcs24VNv-_5U18mhGY9EFKkib1Op0kY-oXuAlN8PEaAcI4saLdNZxZnduAF7jy3zG5Fcb04KPIkbwYYiJQnewD4 Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:00:57.836625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-TestVolumeBootPattern-289690432 Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 2b3617b8bcac4227b1295e294eec664a Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:00:57.838262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '528c37e5-c939-4326-bb37-7b63c853560d'} Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:00:57.839173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:00:57.840751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:00:57.842124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Returning 404 to user: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:00:57.842124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-66086837-025a-4c59-8604-73de412f07ad tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 404 len: 111 microversion: 2.1 time: 0.029561 Jul 21 21:00:57.842124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 391/783] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:57 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:00:57.932891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2117314544", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1053486654", "security_groups": [{"name": "tempest-secgroup-smoke-1588311094"}], "block_device_mapping_v2": [{"uuid": "577c4d47-9765-4667-a53a-2d71f077c165", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4b6565cd-3bec-4ff7-8320-fd7b78910885"}]}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:00:58.046093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] validate_networks() for [('4b6565cd-3bec-4ff7-8320-fd7b78910885', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:00:58.489901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:00:58.490465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:00:58.490787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:00:58.491201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:00:58.491613 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:00:58.500926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:58.501377 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:58.502174 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:00:58.502611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:00:58.509749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:00:58.523560 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:00:58.527580 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for user 2b3617b8bcac4227b1295e294eec664a and project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:00:58.584823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:00:58.586926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='577c4d47-9765-4667-a53a-2d71f077c165',volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:00:58.714331 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [2c77df67-4e94-4489-bc58-7080d68b5ba0] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 21:00:59.722105 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [2c77df67-4e94-4489-bc58-7080d68b5ba0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42604. Jul 21 21:00:59.725853 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5cfa795b-898b-448d-acdb-43451fe3ef29 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.796963 Jul 21 21:00:59.726502 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 393/784] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:00:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:00:59.736258 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8fbf65a2-2d38-4758-ab59-508c880bbc43 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:00:59.736871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8fbf65a2-2d38-4758-ab59-508c880bbc43 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:00:59.788590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8fbf65a2-2d38-4758-ab59-508c880bbc43 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:00:59.795104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8fbf65a2-2d38-4758-ab59-508c880bbc43 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1095 microversion: 2.1 time: 0.062609 Jul 21 21:00:59.795697 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 392/785] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:00:59 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:00.813564 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fe16eca6-68ae-4d04-b4e0-4a34bc8c6d63 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:00.814183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fe16eca6-68ae-4d04-b4e0-4a34bc8c6d63 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:00.868227 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fe16eca6-68ae-4d04-b4e0-4a34bc8c6d63 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:00.874945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fe16eca6-68ae-4d04-b4e0-4a34bc8c6d63 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1095 microversion: 2.1 time: 0.065722 Jul 21 21:01:00.875501 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 394/786] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:00 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:01.891942 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9645f119-57c9-4121-81e3-396780a505f1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:01.893054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9645f119-57c9-4121-81e3-396780a505f1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:01.948526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9645f119-57c9-4121-81e3-396780a505f1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:01.955648 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9645f119-57c9-4121-81e3-396780a505f1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1095 microversion: 2.1 time: 0.067722 Jul 21 21:01:01.956238 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 393/787] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:01 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:02.971566 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-30033d93-65ce-4474-a70f-94c8c0d599b7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:02.972255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-30033d93-65ce-4474-a70f-94c8c0d599b7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:03.026952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-30033d93-65ce-4474-a70f-94c8c0d599b7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:03.034105 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-30033d93-65ce-4474-a70f-94c8c0d599b7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1095 microversion: 2.1 time: 0.066549 Jul 21 21:01:03.039760 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 395/788] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:02 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:04.051041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:04.051661 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:04.058774 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:04.059229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:04.060036 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:04.060478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:04.125461 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:04.133393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5de06263-f414-4d3a-b23a-8bab5dfdbbdf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1145 microversion: 2.1 time: 0.085875 Jul 21 21:01:04.134053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 394/789] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:04 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:05.150552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:05.151232 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:05.159185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:05.159755 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:05.160524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:05.160963 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:05.229046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:05.236950 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a9ada214-6a6e-4fdf-b352-5f113d4e28d3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1211 microversion: 2.1 time: 0.090426 Jul 21 21:01:05.237523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 396/790] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:05 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:06.257019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:06.258110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:06.265121 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:06.265916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:06.267213 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:06.268032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:06.427385 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:06.431602 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:06.437410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1526b536-0d3a-4246-ab88-3343828ab7fe tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.186041 Jul 21 21:01:06.438092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 395/791] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:06 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:06.601637 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-421d596d-d399-499f-b721-30506b6ab744 req-a3a9a9d0-de53-485c-bc60-a7723a8ba4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1a51f4-55bb-4e9b-9f33-05c4013f32e2", "tag": "09c78425-8076-4365-905c-544aaead3728"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:06.613584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-421d596d-d399-499f-b721-30506b6ab744 req-a3a9a9d0-de53-485c-bc60-a7723a8ba4a7 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:06.614045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-421d596d-d399-499f-b721-30506b6ab744 req-a3a9a9d0-de53-485c-bc60-a7723a8ba4a7 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:06.629753 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-421d596d-d399-499f-b721-30506b6ab744 req-a3a9a9d0-de53-485c-bc60-a7723a8ba4a7 service nova] Creating event network-changed:09c78425-8076-4365-905c-544aaead3728 for instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 on hv-cinder-85068 Jul 21 21:01:06.650342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-421d596d-d399-499f-b721-30506b6ab744 req-a3a9a9d0-de53-485c-bc60-a7723a8ba4a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052344 Jul 21 21:01:06.652988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 397/792] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:07.455526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:07.456178 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:07.464121 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:07.464575 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:07.465352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:07.465792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:07.597162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:07.604667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5101e55c-76c6-489a-9887-90c76bf259f7 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.154169 Jul 21 21:01:07.605233 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 396/793] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:07 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:08.619468 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:08.624583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:08.625271 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:08.631595 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:08.632059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:08.632814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:08.633242 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:08.766885 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:08.774310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-031adfdf-51cd-4983-baf8-72e28fe2bd14 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.156281 Jul 21 21:01:08.774871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 398/794] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:08 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:09.791678 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:09.792254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:09.799159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:09.799609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:09.800410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:09.800856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:09.932253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:09.940328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-487e1d81-f4e1-4f60-a0f3-f84c94100158 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.152626 Jul 21 21:01:09.940903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 397/795] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:09 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:10.384017 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:10.384530 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:10.391525 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:10.392001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:10.392766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:10.393204 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:10.478553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lazy-loading 'services' on Instance uuid 5ceb90ef-75ce-4b77-85a4-8441a15b41ce {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:01:10.549683 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ffd68560-c866-4d87-b00b-7ef1b82a4a28 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments/f60baa75-e0dd-45b8-a4c9-d131e843f646" status: 202 len: 0 microversion: 2.1 time: 0.169463 Jul 21 21:01:10.550265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 399/796] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:01:10 2022] DELETE /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments/f60baa75-e0dd-45b8-a4c9-d131e843f646 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:01:10.558727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6e2407c8-ff14-435b-8907-ccee0eded574 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:10.559741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6e2407c8-ff14-435b-8907-ccee0eded574 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:10.565976 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e2407c8-ff14-435b-8907-ccee0eded574 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:10.566482 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e2407c8-ff14-435b-8907-ccee0eded574 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:10.567215 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e2407c8-ff14-435b-8907-ccee0eded574 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:10.567861 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e2407c8-ff14-435b-8907-ccee0eded574 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:10.598769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6e2407c8-ff14-435b-8907-ccee0eded574 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Jul 21 21:01:10.599258 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 398/797] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:01:10 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:10.957552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:10.958157 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:10.964354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:10.964791 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:10.965540 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:10.965967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:11.098156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:11.105614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6bffae30-0869-48e0-96da-a1f87e2d2faf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.152364 Jul 21 21:01:11.106169 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 400/798] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:10 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:11.609593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-109e9949-8634-4826-822a-3caa35657456 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:11.610550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-109e9949-8634-4826-822a-3caa35657456 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:11.617224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-109e9949-8634-4826-822a-3caa35657456 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:11.617677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-109e9949-8634-4826-822a-3caa35657456 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:11.618447 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-109e9949-8634-4826-822a-3caa35657456 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:11.619377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-109e9949-8634-4826-822a-3caa35657456 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:11.648637 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-109e9949-8634-4826-822a-3caa35657456 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043062 Jul 21 21:01:11.649200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 399/799] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:01:11 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:01:11.725416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:11.725961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:11.732384 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:11.733045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:11.733859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:11.734297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:11.760206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:01:11.844332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b238d4a8-6982-4e06-aaac-4edce3f68b1b tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 204 len: 0 microversion: 2.1 time: 0.122391 Jul 21 21:01:11.845463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 401/800] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:01:11 2022] DELETE /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:01:11.854040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:11.856028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:11.864790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:11.865378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:11.866153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:11.866594 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:11.952272 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=4 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:11.995673 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:12.003225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4c128a03-1997-40ac-8f2f-b8086195f47d tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1690 microversion: 2.1 time: 0.153955 Jul 21 21:01:12.003837 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 400/801] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:11 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:12.123817 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:12.124735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:12.130761 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:12.131211 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:12.132003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:12.132445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:12.267878 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:12.275442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4496ed57-503b-458b-b514-b0490205d6c0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.156102 Jul 21 21:01:12.276051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 402/802] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:12 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:13.021436 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:13.022056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:13.028893 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:13.029343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:13.030661 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:13.031093 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:13.296403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:13.297260 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:13.299907 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=10 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:13.305417 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:13.305866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:13.306664 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:13.307102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:13.404222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:13.412886 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3b79a5eb-8374-4170-bdf8-d44a57a78a1a tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1690 microversion: 2.1 time: 0.395344 Jul 21 21:01:13.413640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 401/803] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:13 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1690 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:13.448001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:13.455980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-39d966b6-2427-44b0-a6e3-bf17e7629855 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.167151 Jul 21 21:01:13.456543 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 403/804] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:13 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:01:14.429318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:14.429936 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:14.437237 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:14.437692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:14.438459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:14.438900 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:14.472435 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:14.473058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:14.475356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:14.481002 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:14.481449 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:14.482239 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:14.482679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:14.569583 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:14.577365 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f107557b-f96f-47bf-91e9-18bab81b1050 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1690 microversion: 2.1 time: 0.151870 Jul 21 21:01:14.577957 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 402/805] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:14 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:14.617767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:14.625675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dd19f3a1-eb18-4f0c-9efd-1fe1dcd1f650 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.157833 Jul 21 21:01:14.626234 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 404/806] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:14 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:01:15.594612 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:15.595277 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:15.597632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:15.603109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:15.603555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:15.604353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:15.604795 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:15.643218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:15.644093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:15.651342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:15.651815 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:15.652597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:15.653099 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:15.737456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:15.745467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3b9de8b8-c2b3-4f41-895e-aca117d3dced tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1690 microversion: 2.1 time: 0.155008 Jul 21 21:01:15.746055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 403/807] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:15 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:15.786289 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:15.793751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6e800034-9056-472b-9426-c6cfa273772b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.154295 Jul 21 21:01:15.794321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 405/808] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:15 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:01:16.762985 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:16.763542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:16.770873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:16.771326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:16.772124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:16.772563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:16.810123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:16.810739 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:16.818051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:16.818504 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:16.819285 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:16.819740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:16.900403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:16.909319 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e01e5567-5539-4e04-96c8-19f4fc1f43ce tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1690 microversion: 2.1 time: 0.148818 Jul 21 21:01:16.910144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 404/809] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:16 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:16.954228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:16.961564 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dacb5b50-274f-4266-a562-efb12df183fb tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.155172 Jul 21 21:01:16.962125 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 406/810] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:16 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:01:17.814185 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-c917a776-d5b2-4da4-aa1f-52d30f239bea req-32a944d0-fd07-4af1-9ba9-2f37cd7dd6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ceb90ef-75ce-4b77-85a4-8441a15b41ce", "name": "network-vif-deleted", "tag": "e57d7145-76e9-4c5b-a742-c7da860acb28"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:17.824811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-c917a776-d5b2-4da4-aa1f-52d30f239bea req-32a944d0-fd07-4af1-9ba9-2f37cd7dd6c0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:17.825262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-c917a776-d5b2-4da4-aa1f-52d30f239bea req-32a944d0-fd07-4af1-9ba9-2f37cd7dd6c0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:17.837533 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-c917a776-d5b2-4da4-aa1f-52d30f239bea req-32a944d0-fd07-4af1-9ba9-2f37cd7dd6c0 service nova] Creating event network-vif-deleted:e57d7145-76e9-4c5b-a742-c7da860acb28 for instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce on hv-cinder-85068 Jul 21 21:01:17.844358 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-c917a776-d5b2-4da4-aa1f-52d30f239bea req-32a944d0-fd07-4af1-9ba9-2f37cd7dd6c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033918 Jul 21 21:01:17.845017 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 405/811] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:17.927576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:17.929106 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:17.936902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:17.938756 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:17.939882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:17.940471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:17.975868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:17.976575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:17.977192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lazy-loading 'fault' on Instance uuid 5ceb90ef-75ce-4b77-85a4-8441a15b41ce {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:01:17.979986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:17.980771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:18.003789 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:18.006132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:18.009132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:18.010377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:18.034298 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:18.042287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-989965e0-3d44-427c-a81b-a9908bc566b1 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 200 len: 1335 microversion: 2.1 time: 0.119147 Jul 21 21:01:18.043603 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 407/812] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:17 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:18.169480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:18.177649 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-92a3fe43-21ec-4955-aed9-b2661ea79162 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.202849 Jul 21 21:01:18.178153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 406/813] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:17 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:01:19.060663 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:19.061277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 5ceb90ef-75ce-4b77-85a4-8441a15b41ce] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:19.068203 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:19.068653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:19.069419 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:19.069855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:19.084137 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] HTTP exception thrown: Instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce could not be found. Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Request method failure captured: Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce HTTP/1.1 Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byallxj-2zIOzbBTUsZ6s8zHDXiJcycfCm-0RzgZz8_G4ZMyQWr6DfdbRbtxCoixJ3bYreLJTWtQGm0RkxmhjqM0kKNO_2gNp_qaUH1qrUrvKQXuW63hJjKZSd_dyfntXJFzmOogi8eUrIpcMTbgiydWoSb1Njj36DS5PWyvRHgrus Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:01:19.085764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 24e4efb87cd34008a1b83c0ea0cce5aa Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce could not be found. Jul 21 21:01:19.087311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '5ceb90ef-75ce-4b77-85a4-8441a15b41ce'} Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce could not be found. Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:01:19.088380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce could not be found. Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce could not be found. Jul 21 21:01:19.089599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:19.090764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Returning 404 to user: Instance 5ceb90ef-75ce-4b77-85a4-8441a15b41ce could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:01:19.090764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9d8419b1-7e31-4fec-81ea-e9bdc67079cb tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce" status: 404 len: 111 microversion: 2.1 time: 0.030346 Jul 21 21:01:19.090764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 408/814] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:19 2022] GET /compute/v2.1/servers/5ceb90ef-75ce-4b77-85a4-8441a15b41ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:01:19.096515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-eac84259-fb74-437f-8bb6-2392ddc10c80 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '.version_select at 0x7f3540063430>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:19.113678 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-eac84259-fb74-437f-8bb6-2392ddc10c80 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102084582" status: 202 len: 0 microversion: 2.1 time: 0.021774 Jul 21 21:01:19.114246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 407/815] 10.222.0.60 () {58 vars in 1220 bytes} [Thu Jul 21 21:01:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102084582 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:01:19.194694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:19.195294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:19.201266 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:19.201711 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:19.202474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:19.202944 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:19.361351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:19.370073 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e32a9d91-3e73-4108-89e6-d0c4a05f03fa tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.179405 Jul 21 21:01:19.370848 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 409/816] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:19 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:20.439415 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:20.440088 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:20.446755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:20.447193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:20.447982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:20.448423 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:20.583147 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:20.591169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b82a1e2c-a3d0-4ddc-90ec-ade9e7f18530 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.208630 Jul 21 21:01:20.591766 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 408/817] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:20 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:20.664165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-51d5f3c5-7b8a-4cbc-92ae-e00e2e45d91e req-b76fb5f8-920d-47fe-b67e-6945a79899ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1a51f4-55bb-4e9b-9f33-05c4013f32e2", "name": "network-vif-plugged", "status": "completed", "tag": "09c78425-8076-4365-905c-544aaead3728"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:20.673293 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-51d5f3c5-7b8a-4cbc-92ae-e00e2e45d91e req-b76fb5f8-920d-47fe-b67e-6945a79899ab service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:20.673738 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-51d5f3c5-7b8a-4cbc-92ae-e00e2e45d91e req-b76fb5f8-920d-47fe-b67e-6945a79899ab service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:20.684814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-51d5f3c5-7b8a-4cbc-92ae-e00e2e45d91e req-b76fb5f8-920d-47fe-b67e-6945a79899ab service nova] Creating event network-vif-plugged:09c78425-8076-4365-905c-544aaead3728 for instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 on hv-cinder-85068 Jul 21 21:01:20.690959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-51d5f3c5-7b8a-4cbc-92ae-e00e2e45d91e req-b76fb5f8-920d-47fe-b67e-6945a79899ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030514 Jul 21 21:01:20.691552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 410/818] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:21.608169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:21.608714 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:21.615908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:21.616354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:21.617114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:21.617551 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:21.748789 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:21.756336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-51b87adf-53c2-4462-b2b2-68726c0900f6 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1267 microversion: 2.1 time: 0.152117 Jul 21 21:01:21.756909 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 409/819] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:21 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:22.040988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:22.041595 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:22.048138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.049362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:22.049714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.050230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:22.076938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:01:22.080864 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:22.153485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d3dfaa78-83f8-44ea-9a8a-c22315082ac6 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "DELETE /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 204 len: 0 microversion: 2.1 time: 0.117075 Jul 21 21:01:22.154265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 411/820] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:01:22 2022] DELETE /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:01:22.163131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:22.163780 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:22.170246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.170704 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:22.171473 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.171970 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:22.304953 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:22.312409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fef266eb-3c74-4e57-90da-06acb20f1889 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1509 microversion: 2.1 time: 0.153738 Jul 21 21:01:22.313679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 410/821] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:22 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:22.773699 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:22.774398 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:22.780292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.780736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:22.781985 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.782416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:22.914350 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:22.921750 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-364b412a-1dcb-43dc-946e-45acc362cb5d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1454 microversion: 2.1 time: 0.152405 Jul 21 21:01:22.922912 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 412/822] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:22 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:22.938013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:22.938796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:22.945220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.945661 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:22.946442 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:22.946877 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:23.076940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:23.085101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8cea2c6a-592c-4136-909b-ee53613ea63e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1454 microversion: 2.1 time: 0.150824 Jul 21 21:01:23.085665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 411/823] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:22 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:23.330403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:23.331060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:23.337477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:23.337925 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:23.338684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:23.339166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:23.472142 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:23.479675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6647362c-b76d-45f0-9d99-06113b62d699 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1509 microversion: 2.1 time: 0.153850 Jul 21 21:01:23.487997 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 413/824] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:23 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:24.172580 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-4cc23eef-9225-40da-909a-7998985e1b10 req-e38c12ef-2159-4316-a174-a6349f328df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77154d49-ec36-4137-8c96-ceb20188d32e", "name": "network-vif-deleted", "tag": "021cc3b8-5795-418d-85f7-7d0dcc124d4d"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:24.182226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-4cc23eef-9225-40da-909a-7998985e1b10 req-e38c12ef-2159-4316-a174-a6349f328df0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:24.182969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-4cc23eef-9225-40da-909a-7998985e1b10 req-e38c12ef-2159-4316-a174-a6349f328df0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:24.195809 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-4cc23eef-9225-40da-909a-7998985e1b10 req-e38c12ef-2159-4316-a174-a6349f328df0 service nova] Creating event network-vif-deleted:021cc3b8-5795-418d-85f7-7d0dcc124d4d for instance 77154d49-ec36-4137-8c96-ceb20188d32e on hv-cinder-85068 Jul 21 21:01:24.200743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-4cc23eef-9225-40da-909a-7998985e1b10 req-e38c12ef-2159-4316-a174-a6349f328df0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Jul 21 21:01:24.201351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 412/825] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:24.497731 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:24.498342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:24.505257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:24.506071 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:24.507138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:24.507822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:24.541893 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:24.542658 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:24.543186 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lazy-loading 'fault' on Instance uuid 77154d49-ec36-4137-8c96-ceb20188d32e {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:01:24.587813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:24.596499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-01a639aa-3687-42fe-8332-47bacd7433e2 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 200 len: 1312 microversion: 2.1 time: 0.102566 Jul 21 21:01:24.598122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 414/826] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:24 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:24.819300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-c3c47830-d0db-42ee-9691-291edf522b67 req-9326baba-ec27-4f94-9596-630d2a6df1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1a51f4-55bb-4e9b-9f33-05c4013f32e2", "tag": "09c78425-8076-4365-905c-544aaead3728"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:24.829193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-c3c47830-d0db-42ee-9691-291edf522b67 req-9326baba-ec27-4f94-9596-630d2a6df1b1 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:24.829718 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-c3c47830-d0db-42ee-9691-291edf522b67 req-9326baba-ec27-4f94-9596-630d2a6df1b1 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:24.841655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-c3c47830-d0db-42ee-9691-291edf522b67 req-9326baba-ec27-4f94-9596-630d2a6df1b1 service nova] Creating event network-changed:09c78425-8076-4365-905c-544aaead3728 for instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 on hv-cinder-85068 Jul 21 21:01:24.848264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-c3c47830-d0db-42ee-9691-291edf522b67 req-9326baba-ec27-4f94-9596-630d2a6df1b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105278 Jul 21 21:01:24.848923 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 413/827] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:25.613666 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:25.614293 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 77154d49-ec36-4137-8c96-ceb20188d32e] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:25.621562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:25.622007 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:25.622780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:25.623223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:25.637960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] HTTP exception thrown: Instance 77154d49-ec36-4137-8c96-ceb20188d32e could not be found. Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Request method failure captured: Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e HTTP/1.1 Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byallxj-2zIOzbBTUsZ6s8zHDXiJcycfCm-0RzgZz8_G4ZMyQWr6DfdbRbtxCoixJ3bYreLJTWtQGm0RkxmhjqM0kKNO_2gNp_qaUH1qrUrvKQXuW63hJjKZSd_dyfntXJFzmOogi8eUrIpcMTbgiydWoSb1Njj36DS5PWyvRHgrus Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:01:25.639678 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 24e4efb87cd34008a1b83c0ea0cce5aa Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 77154d49-ec36-4137-8c96-ceb20188d32e could not be found. Jul 21 21:01:25.641237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '77154d49-ec36-4137-8c96-ceb20188d32e'} Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77154d49-ec36-4137-8c96-ceb20188d32e could not be found. Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:01:25.641976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77154d49-ec36-4137-8c96-ceb20188d32e could not be found. Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77154d49-ec36-4137-8c96-ceb20188d32e could not be found. Jul 21 21:01:25.643583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:01:25.644895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Returning 404 to user: Instance 77154d49-ec36-4137-8c96-ceb20188d32e could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:01:25.644895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f4b3cb5f-6066-4ffd-b086-7f8b8cd13959 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e" status: 404 len: 111 microversion: 2.1 time: 0.032128 Jul 21 21:01:25.644895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 415/828] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:25 2022] GET /compute/v2.1/servers/77154d49-ec36-4137-8c96-ceb20188d32e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:01:25.651070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:25.651665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:25.658185 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:25.658615 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:25.659402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:25.659870 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:25.686257 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Going to try to terminate instance {{(pid=124647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:01:25.714191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:25.766127 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bf98b7be-71e9-4069-a487-53765e8fcbc8 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 204 len: 0 microversion: 2.1 time: 0.119217 Jul 21 21:01:25.766757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 414/829] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:01:25 2022] DELETE /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:01:25.775410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:25.776171 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:25.782945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:25.783445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:25.784278 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:25.784757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:25.920426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:25.928538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-57e29cd7-66e6-4243-b49d-b9ac98ef87f0 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.157085 Jul 21 21:01:25.929108 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 416/830] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:25 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:26.945827 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:26.946487 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:26.953955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:26.954414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:26.955201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:26.955641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:27.096552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e4efb87cd34008a1b83c0ea0cce5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e9d8f8b55c4ef586252456ea195266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:27.104222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-89dc6dfb-617e-4ab2-be5a-7bfa683a1ea4 tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 200 len: 1523 microversion: 2.1 time: 0.162769 Jul 21 21:01:27.104816 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 415/831] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:26 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:27.401333 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-695113c9-5b43-451c-b84e-c30a3e48a510 req-1643ee75-5285-4a3c-8248-5ac82fe0e939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ddeb6ba-597a-4d70-b8ce-8a803668cbdd", "name": "network-vif-deleted", "tag": "7fbf5542-a0df-44eb-afda-0f932b4c5b95"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:27.410897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-695113c9-5b43-451c-b84e-c30a3e48a510 req-1643ee75-5285-4a3c-8248-5ac82fe0e939 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:27.411445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-695113c9-5b43-451c-b84e-c30a3e48a510 req-1643ee75-5285-4a3c-8248-5ac82fe0e939 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:27.423973 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-695113c9-5b43-451c-b84e-c30a3e48a510 req-1643ee75-5285-4a3c-8248-5ac82fe0e939 service nova] Creating event network-vif-deleted:7fbf5542-a0df-44eb-afda-0f932b4c5b95 for instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd on hv-cinder-85068 Jul 21 21:01:27.428869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-695113c9-5b43-451c-b84e-c30a3e48a510 req-1643ee75-5285-4a3c-8248-5ac82fe0e939 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031205 Jul 21 21:01:27.429459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 417/832] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:28.122481 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:28.123098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] [instance: 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:28.130136 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:28.130582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:28.131342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:28.131810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:28.294411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] HTTP exception thrown: Instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd could not be found. Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Request method failure captured: Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd HTTP/1.1 Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2byallxj-2zIOzbBTUsZ6s8zHDXiJcycfCm-0RzgZz8_G4ZMyQWr6DfdbRbtxCoixJ3bYreLJTWtQGm0RkxmhjqM0kKNO_2gNp_qaUH1qrUrvKQXuW63hJjKZSd_dyfntXJFzmOogi8eUrIpcMTbgiydWoSb1Njj36DS5PWyvRHgrus Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:01:28.296096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9e9d8f8b55c4ef586252456ea195266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: d9e9d8f8b55c4ef586252456ea195266 Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1288952865 Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 24e4efb87cd34008a1b83c0ea0cce5aa Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1288952865-project Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd could not be found. Jul 21 21:01:28.298149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '4ddeb6ba-597a-4d70-b8ce-8a803668cbdd'} Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd could not be found. Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:01:28.299034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd could not be found. Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd could not be found. Jul 21 21:01:28.300264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:01:28.301411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] Returning 404 to user: Instance 4ddeb6ba-597a-4d70-b8ce-8a803668cbdd could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:01:28.301411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-175946f6-5213-4670-ad46-8112d9c503df tempest-ServerRescueNegativeTestJSON-1288952865 tempest-ServerRescueNegativeTestJSON-1288952865-project] 10.222.0.60 "GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd" status: 404 len: 111 microversion: 2.1 time: 0.180021 Jul 21 21:01:28.301411 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 416/833] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:28 2022] GET /compute/v2.1/servers/4ddeb6ba-597a-4d70-b8ce-8a803668cbdd => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:01:55.468571 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:55.469311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:55.474461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1755210079", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "networks": [{"uuid": "f0f260f2-2b96-4528-8f03-3a247ced81a9"}]}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:55.526442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] validate_networks() for [('f0f260f2-2b96-4528-8f03-3a247ced81a9', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:01:55.871559 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:01:55.872015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:01:55.872484 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:01:55.872886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:01:55.873323 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:01:55.882208 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:55.882579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:55.883362 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:55.883833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:55.901024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Getting quotas for project 99bf599415154f1eb8ebdf982099e635. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:01:55.904888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Getting quotas for user 356d7835faeb4ea09cf7580f5f467473 and project 99bf599415154f1eb8ebdf982099e635. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:01:55.915999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:01:55.918268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:01:55.962844 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d657656e-ed68-4ef9-839e-6763e13ae8e7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495771 Jul 21 21:01:55.966937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 418/834] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:01:55.974643 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-80f817f1-d3a2-4d3f-8aca-b3da44300d94 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:55.975257 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-80f817f1-d3a2-4d3f-8aca-b3da44300d94 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:55.977662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:55.979129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:01:56.042980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-80f817f1-d3a2-4d3f-8aca-b3da44300d94 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:56.050169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-80f817f1-d3a2-4d3f-8aca-b3da44300d94 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1214 microversion: 2.1 time: 0.080270 Jul 21 21:01:56.050726 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 417/835] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:55 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:57.067361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:57.068772 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:57.075347 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:57.075920 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:57.076768 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:57.077279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:57.166332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:57.174731 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c67ecf6c-167b-46d4-b401-d8e51c79f75f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1284 microversion: 2.1 time: 0.111579 Jul 21 21:01:57.175394 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 419/836] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:57 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:58.192658 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:58.193273 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:58.201235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:58.201686 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:58.202484 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:58.202922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:58.337810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:58.345348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4033dc73-cca6-40cb-b06d-50818a36c3dc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.157199 Jul 21 21:01:58.346287 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 418/837] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:58 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:01:58.364407 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-3e3dd6f7-daad-4933-9d13-bdd6401a3538 req-f61bb5fe-e5cd-4ea4-b258-40fa5c4a3841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a85047b-e6b4-4098-8ebc-c7182c8ceb0b", "tag": "d80379c2-97d4-4451-8830-16c63fa2aa8f"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:01:58.373599 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3e3dd6f7-daad-4933-9d13-bdd6401a3538 req-f61bb5fe-e5cd-4ea4-b258-40fa5c4a3841 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:58.374179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3e3dd6f7-daad-4933-9d13-bdd6401a3538 req-f61bb5fe-e5cd-4ea4-b258-40fa5c4a3841 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:58.387687 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-3e3dd6f7-daad-4933-9d13-bdd6401a3538 req-f61bb5fe-e5cd-4ea4-b258-40fa5c4a3841 service nova] Creating event network-changed:d80379c2-97d4-4451-8830-16c63fa2aa8f for instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b on hv-cinder-85068 Jul 21 21:01:58.392757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-3e3dd6f7-daad-4933-9d13-bdd6401a3538 req-f61bb5fe-e5cd-4ea4-b258-40fa5c4a3841 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032596 Jul 21 21:01:58.393842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 420/838] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:01:59.363401 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:01:59.364069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:01:59.370799 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:59.371288 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:59.372082 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:01:59.372526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:01:59.500824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:01:59.508963 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-60f015db-6604-43fe-89c1-0a57f38c10ea tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.150438 Jul 21 21:01:59.509702 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 419/839] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:01:59 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:00.527493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:00.528242 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:00.535130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:00.535564 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:00.536354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:00.536779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:00.667774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:00.675175 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5a06acf6-8a0a-41dd-979d-b0b29d58699b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.152327 Jul 21 21:02:00.675758 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 421/840] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:00 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:01.691274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:01.691921 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:01.698436 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:01.698887 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:01.699693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:01.700179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:01.832138 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:01.839489 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-edd98de3-04f4-43b6-a528-8dbb02a62858 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.152275 Jul 21 21:02:01.840076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 420/841] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:01 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:02.857119 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:02.857735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:02.866277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:02.866830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:02.867620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:02.868086 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:03.001225 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:03.010083 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d6c45aec-3448-45bf-a360-ea76bfd3d045 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.156978 Jul 21 21:02:03.010886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 422/842] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:02 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:04.027402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:04.028045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:04.034646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:04.035102 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:04.035905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:04.036347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:04.167013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:04.174970 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-87f7098a-9419-471a-8984-167a30f2f137 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.151407 Jul 21 21:02:04.175549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 421/843] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:04 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:04.986930 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-89f13c8c-49f1-4ccd-86ec-9aa66fd1826f req-3166f4e2-e53d-461c-bd8c-800b5ae195cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a85047b-e6b4-4098-8ebc-c7182c8ceb0b", "name": "network-vif-plugged", "status": "completed", "tag": "d80379c2-97d4-4451-8830-16c63fa2aa8f"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:04.996264 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-89f13c8c-49f1-4ccd-86ec-9aa66fd1826f req-3166f4e2-e53d-461c-bd8c-800b5ae195cb service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:04.996702 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-89f13c8c-49f1-4ccd-86ec-9aa66fd1826f req-3166f4e2-e53d-461c-bd8c-800b5ae195cb service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:05.008323 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-89f13c8c-49f1-4ccd-86ec-9aa66fd1826f req-3166f4e2-e53d-461c-bd8c-800b5ae195cb service nova] Creating event network-vif-plugged:d80379c2-97d4-4451-8830-16c63fa2aa8f for instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b on hv-cinder-85068 Jul 21 21:02:05.013156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-89f13c8c-49f1-4ccd-86ec-9aa66fd1826f req-3166f4e2-e53d-461c-bd8c-800b5ae195cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029900 Jul 21 21:02:05.013734 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 423/844] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:05.191810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:05.192359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:05.199047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:05.199495 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:05.200376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:05.200816 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:05.336099 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:05.343994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c362d867-412e-466e-9256-a32529792c37 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.156315 Jul 21 21:02:05.344564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 422/845] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:05 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:05.854509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-019e19dd-5239-4bbc-bf1b-4a9a611dff41 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:05.855087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-019e19dd-5239-4bbc-bf1b-4a9a611dff41 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:05.861336 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-019e19dd-5239-4bbc-bf1b-4a9a611dff41 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:05.861782 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-019e19dd-5239-4bbc-bf1b-4a9a611dff41 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:05.862532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-019e19dd-5239-4bbc-bf1b-4a9a611dff41 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:05.862967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-019e19dd-5239-4bbc-bf1b-4a9a611dff41 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:05.886697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-019e19dd-5239-4bbc-bf1b-4a9a611dff41 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/ips" status: 200 len: 151 microversion: 2.20 time: 0.036407 Jul 21 21:02:05.887255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 424/846] 10.222.0.60 () {60 vars in 1288 bytes} [Thu Jul 21 21:02:05 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:02:06.050511 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-38757053-8d80-4805-8a61-87c565ada039 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:06.052094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-38757053-8d80-4805-8a61-87c565ada039 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:06.054014 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:06.059808 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38757053-8d80-4805-8a61-87c565ada039 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.060326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38757053-8d80-4805-8a61-87c565ada039 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.061246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38757053-8d80-4805-8a61-87c565ada039 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.061693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-38757053-8d80-4805-8a61-87c565ada039 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.103446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-38757053-8d80-4805-8a61-87c565ada039 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056963 Jul 21 21:02:06.104237 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 423/847] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:02:06 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:02:06.172475 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:06.173000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:06.175440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:06.177102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:06.183550 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.184034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.185169 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.185623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.216204 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:02:06.293923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-68838972-2cb6-4e63-9ede-450c5f7ebb4c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 204 len: 0 microversion: 2.1 time: 0.125042 Jul 21 21:02:06.294503 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 425/848] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:02:06 2022] DELETE /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:02:06.304776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:06.305492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:06.312731 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.313234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.313999 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.314434 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.362390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:06.363003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:06.370192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.370729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.371578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:06.372045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:06.451968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:06.460503 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0c3aab5c-4a4e-4f6d-82ca-0d4cced32040 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1674 microversion: 2.1 time: 0.161365 Jul 21 21:02:06.461116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 424/849] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:06 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:06.510673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:06.518054 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5560f7f4-db4d-40f1-8ea4-a27a7120f9c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1314 microversion: 2.1 time: 0.159965 Jul 21 21:02:06.518615 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 426/850] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:06 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:07.478839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:07.479448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:07.486553 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:07.487020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:07.488468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:07.488468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:07.534643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:07.536207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:07.543570 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:07.544106 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:07.545061 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:07.545579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:07.622980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:07.631676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-aa28e8d0-bb81-4dc6-bc11-972843a7ca3f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1674 microversion: 2.1 time: 0.156908 Jul 21 21:02:07.632448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 425/851] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:07 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:07.681040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:07.688363 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-83415059-0be7-4ea1-b342-de00f34d613d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1498 microversion: 2.1 time: 0.157666 Jul 21 21:02:07.688925 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 427/852] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:07 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:08.087154 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:08.087693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:08.093710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.094167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.095026 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.095470 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.118710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lazy-loading 'flavor' on Instance uuid fb4fa343-16d7-4f75-a3e3-3abef4456ed6 {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:02:08.253439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:08.254038 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:08.261085 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.261611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.262458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.262897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.288490 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:02:08.366928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4155f92e-baa8-4fcf-81cf-08b010116340 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 204 len: 0 microversion: 2.1 time: 0.117113 Jul 21 21:02:08.367499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 428/853] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:02:08 2022] DELETE /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 21:02:08.375839 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:08.376519 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:08.380364 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f1056db6-befc-4669-bdc4-40a6e5496034 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/action" status: 202 len: 0 microversion: 2.20 time: 0.296740 Jul 21 21:02:08.381006 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 426/854] 10.222.0.60 () {62 vars in 1318 bytes} [Thu Jul 21 21:02:08 2022] POST /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:02:08.385640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.386094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.386873 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.387360 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.389083 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:08.389779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:08.397552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.398008 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.398790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.399403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.521400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:08.530602 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-01a63553-ca99-40ac-98de-f10fdbdbb86b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1504 microversion: 2.1 time: 0.158702 Jul 21 21:02:08.531176 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 429/855] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:08 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:08.545785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:08.554022 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:08.555618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:08.557118 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c660ec0e-05fd-43af-8640-0c7564884254 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.171923 Jul 21 21:02:08.557606 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 427/856] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:08 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:08.650058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:08.650627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:08.657192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.657638 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.658397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:08.658829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:08.791684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:08.799131 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-970265e7-11b2-46a3-8166-9948f0ea872e tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1674 microversion: 2.1 time: 0.152995 Jul 21 21:02:08.799696 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 430/857] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:08 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:09.547533 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:09.548175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:09.555495 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:09.555996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:09.556750 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:09.557194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:09.577114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:09.577800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:09.584373 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:09.584822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:09.585592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:09.586025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:09.689076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:09.696817 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6ca15f9b-7b5c-4ee2-8ff6-c34b910f332f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1504 microversion: 2.1 time: 0.153143 Jul 21 21:02:09.697822 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 428/858] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:09 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:09.715487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:09.724489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:09.725989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:09.727143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2b17e1db-6cb2-4b3a-9f43-7b2f0bc70ee6 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.154312 Jul 21 21:02:09.727704 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 431/859] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:09 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:09.816175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:09.817345 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:09.823440 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:09.823925 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:09.824692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:09.825133 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:09.959869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:09.967556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c216b488-65db-4fe2-bf23-e3d958b41cba tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1674 microversion: 2.1 time: 0.155183 Jul 21 21:02:09.968173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 429/860] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:09 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:10.714111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:10.714641 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:10.721166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:10.721764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:10.722378 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:10.722892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:10.748782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:10.749396 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:10.757573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:10.758024 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:10.758807 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:10.759243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:10.904255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:10.913318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:10.914848 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:10.916085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-124f70c1-1ddf-46e8-9e3d-7fb655371fa2 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.173022 Jul 21 21:02:10.916656 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 430/861] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:10 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:10.977213 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-8d23ee52-7f65-4d94-911a-ce5937f11f5d req-a793f4eb-5323-4859-a222-30d3c40c20f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a0918b-9ae2-48d6-943a-bff67b0e7ca6", "name": "network-vif-unplugged", "status": "completed", "tag": "3d26f1bb-0cc8-4534-94aa-7d6db164e0dd"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:10.990478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-8d23ee52-7f65-4d94-911a-ce5937f11f5d req-a793f4eb-5323-4859-a222-30d3c40c20f4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:10.990931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-8d23ee52-7f65-4d94-911a-ce5937f11f5d req-a793f4eb-5323-4859-a222-30d3c40c20f4 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:11.002579 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-8d23ee52-7f65-4d94-911a-ce5937f11f5d req-a793f4eb-5323-4859-a222-30d3c40c20f4 service nova] Creating event network-vif-unplugged:3d26f1bb-0cc8-4534-94aa-7d6db164e0dd for instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 on hv-cinder-85068 Jul 21 21:02:11.008876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-8d23ee52-7f65-4d94-911a-ce5937f11f5d req-a793f4eb-5323-4859-a222-30d3c40c20f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036761 Jul 21 21:02:11.009795 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 431/862] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:02:11.014772 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:11.015513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:11.022545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:11.023039 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:11.023839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:11.024284 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:11.169235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:11.177754 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-88d6e539-ba48-4805-b4c6-91cfcefeb30c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1674 microversion: 2.1 time: 0.166932 Jul 21 21:02:11.178333 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 432/863] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:11 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:11.327135 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:11.334799 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-683d0ff9-aa7a-44e7-9b6e-9d136a0880d0 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1504 microversion: 2.1 time: 0.624678 Jul 21 21:02:11.335366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 432/864] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:10 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1504 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:11.941699 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-6559af0c-aee3-4110-a0b0-7727ba200106 req-4155fdba-8cf1-404f-b4cb-27e5be443c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a85047b-e6b4-4098-8ebc-c7182c8ceb0b", "name": "network-vif-deleted", "tag": "d80379c2-97d4-4451-8830-16c63fa2aa8f"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:11.948978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:11.949594 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:11.951995 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-6559af0c-aee3-4110-a0b0-7727ba200106 req-4155fdba-8cf1-404f-b4cb-27e5be443c84 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:11.952499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-6559af0c-aee3-4110-a0b0-7727ba200106 req-4155fdba-8cf1-404f-b4cb-27e5be443c84 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:11.956456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:11.957741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:11.958707 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:11.959312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:11.967219 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-6559af0c-aee3-4110-a0b0-7727ba200106 req-4155fdba-8cf1-404f-b4cb-27e5be443c84 service nova] Creating event network-vif-deleted:d80379c2-97d4-4451-8830-16c63fa2aa8f for instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b on hv-cinder-85068 Jul 21 21:02:11.974087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-6559af0c-aee3-4110-a0b0-7727ba200106 req-4155fdba-8cf1-404f-b4cb-27e5be443c84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Jul 21 21:02:11.974747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 433/865] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:11.976363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:12.156876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:12.165866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:12.167577 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:12.168914 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a03087ba-9c7b-4323-962a-349fff442616 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.237959 Jul 21 21:02:12.169588 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 433/866] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:11 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:12.198938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:12.200432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:12.210535 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:12.211274 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:12.212252 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:12.212855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:12.217723 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:12.289563 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:12.297117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ac250aca-0788-4f9d-89bb-249daa4d5900 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 200 len: 1323 microversion: 2.1 time: 0.106424 Jul 21 21:02:12.297682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 434/867] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:12 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 1323 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:12.352646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:12.353410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:12.359615 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:12.360157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:12.361008 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:12.361449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:12.394507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:12.394959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:12.395409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lazy-loading 'fault' on Instance uuid 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:02:12.437738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:12.445919 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b9a39b58-acc9-4782-91a5-cc95e0f61216 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 200 len: 1304 microversion: 2.1 time: 0.097282 Jul 21 21:02:12.446493 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 434/868] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:12 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:13.186381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:13.186987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:13.194247 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.194687 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.195517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.195931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.314477 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:13.315165 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:13.322357 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.322811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.323583 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.324051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.331452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:13.337422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] HTTP exception thrown: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Request method failure captured: Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 HTTP/1.1 Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b0etTfVWqRkg5EWCQlGrh6GY0sjSO7cKL9Wi7ZrgFhs2ci99jiNxzgIXyYH2J5hDKeMbXBzzJb7D9szoPnwhoIKsGdMEbLr9HQYaOAv4v8rBgNzsHbfd-Ne74GtIw0avJLwM15ulmfWpgXVLDA0MkeQCGNn297El8OJ7uCsjyfewBw Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:02:13.339098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c51d3542adae4062a487ab85d673140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: ab2bc1eb1eb845ec82b79adee04a51e7 Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:02:13.340782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '71a0918b-9ae2-48d6-943a-bff67b0e7ca6'} Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:02:13.341659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:02:13.343094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.345336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Returning 404 to user: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:02:13.345492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:13.345598 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-dae99078-a6f1-430d-baf7-527f7aec1342 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 404 len: 111 microversion: 2.1 time: 0.030014 Jul 21 21:02:13.345706 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:13.345808 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 435/869] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:13 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 21:02:13.345908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ab8ee76e-148c-408c-a52b-ad5d10631bf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.159912 Jul 21 21:02:13.345908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 435/870] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:13 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:13.350994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2a9e609c-6518-499c-a54f-d0450ef528d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '.version_select at 0x7f3540024ca0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:13.369221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2a9e609c-6518-499c-a54f-d0450ef528d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310789252" status: 202 len: 0 microversion: 2.1 time: 0.023322 Jul 21 21:02:13.369783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 436/871] 10.222.0.60 () {58 vars in 1220 bytes} [Thu Jul 21 21:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310789252 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:02:13.463562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:13.464552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:13.470794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.471263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.472071 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.472499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.486279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] HTTP exception thrown: Instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b could not be found. Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Request method failure captured: Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b HTTP/1.1 Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b7Bd4kQY6ICEu9dfhz_Eh7_SMahRvkdctim24zF_aUOZtoIRKMURVvKLG_JF1PLiLQ-pE4-HAF6M0HvcLl1k_diXcnViysElyxlqlGVaNHKVhKGT-EA61lpwip4-9OHY1x6UpXCMYBbLUbnFGCj-H1abytFEBKQwF3-yczv7yC03nM Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 99bf599415154f1eb8ebdf982099e635 Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesActionsTest-1993371441 Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:02:13.488064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99bf599415154f1eb8ebdf982099e635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99bf599415154f1eb8ebdf982099e635"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99bf599415154f1eb8ebdf982099e635"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99bf599415154f1eb8ebdf982099e635"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesActionsTest-1993371441 Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 99bf599415154f1eb8ebdf982099e635 Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesActionsTest-1993371441 Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesActionsTest-1993371441-project Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 356d7835faeb4ea09cf7580f5f467473 Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesActionsTest-1993371441-project Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b could not be found. Jul 21 21:02:13.490146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '8a85047b-e6b4-4098-8ebc-c7182c8ceb0b'} Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b could not be found. Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:02:13.491310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b could not be found. Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b could not be found. Jul 21 21:02:13.492728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:13.493931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Returning 404 to user: Instance 8a85047b-e6b4-4098-8ebc-c7182c8ceb0b could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:02:13.493931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b87c5a66-2625-4528-8513-1cdf9c405066 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b" status: 404 len: 111 microversion: 2.1 time: 0.030567 Jul 21 21:02:13.493931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 436/872] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:13 2022] GET /compute/v2.1/servers/8a85047b-e6b4-4098-8ebc-c7182c8ceb0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:02:13.543834 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1505433869", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "networks": [{"uuid": "f0f260f2-2b96-4528-8f03-3a247ced81a9"}]}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:13.600657 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] validate_networks() for [('f0f260f2-2b96-4528-8f03-3a247ced81a9', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:02:13.967773 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:02:13.968202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:02:13.968679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:02:13.969116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:02:13.969762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:02:13.979319 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.979792 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.980591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:13.981066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:13.992979 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-73392c9c-0c45-48bf-9aec-dd0c0fa62240 req-5546b12e-8c72-4095-b600-d09502d36df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a0918b-9ae2-48d6-943a-bff67b0e7ca6", "name": "network-vif-deleted", "tag": "3d26f1bb-0cc8-4534-94aa-7d6db164e0dd"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:13.999159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Getting quotas for project 99bf599415154f1eb8ebdf982099e635. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:02:14.002022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-73392c9c-0c45-48bf-9aec-dd0c0fa62240 req-5546b12e-8c72-4095-b600-d09502d36df5 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:14.002568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-73392c9c-0c45-48bf-9aec-dd0c0fa62240 req-5546b12e-8c72-4095-b600-d09502d36df5 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:14.006692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Getting quotas for user 356d7835faeb4ea09cf7580f5f467473 and project 99bf599415154f1eb8ebdf982099e635. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:02:14.015918 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-73392c9c-0c45-48bf-9aec-dd0c0fa62240 req-5546b12e-8c72-4095-b600-d09502d36df5 service nova] Creating event network-vif-deleted:3d26f1bb-0cc8-4534-94aa-7d6db164e0dd for instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 on hv-cinder-85068 Jul 21 21:02:14.021377 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-73392c9c-0c45-48bf-9aec-dd0c0fa62240 req-5546b12e-8c72-4095-b600-d09502d36df5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Jul 21 21:02:14.021929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 437/873] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:14.024572 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:02:14.026935 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:02:14.037412 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-74e6ca10-36ad-4beb-ab13-7e7adf5d693c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'create', calling method: .version_select at 0x7f35400f5a60>, body: {"keypair": {"name": "tempest-keypair-1994963326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2g1Qsqhb4uktm5lSOMUHBMVXAq6Bvge0EOj3hknc/ykzM2sJAcW2bM+kptNUqgA8M40pYoFKQ9ldJalATfZYP9SGsYs1gGLxEc3dhI+qgFoBMUxxhdLgHMUkJjUTX6DQ=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:14.051849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-74e6ca10-36ad-4beb-ab13-7e7adf5d693c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for project c51d3542adae4062a487ab85d673140d. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:02:14.056505 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-74e6ca10-36ad-4beb-ab13-7e7adf5d693c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for user ab2bc1eb1eb845ec82b79adee04a51e7 and project c51d3542adae4062a487ab85d673140d. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:02:14.074540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-093a972e-cdbe-4441-9ab4-8ec928b88b5b tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534715 Jul 21 21:02:14.075191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 437/874] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:02:14.081788 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-74e6ca10-36ad-4beb-ab13-7e7adf5d693c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048903 Jul 21 21:02:14.082386 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 438/875] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 21:02:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:02:14.087762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d7466b47-2e03-436c-85b5-8e32905de728 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:14.087762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d7466b47-2e03-436c-85b5-8e32905de728 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:14.151039 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d7466b47-2e03-436c-85b5-8e32905de728 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:14.160046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d7466b47-2e03-436c-85b5-8e32905de728 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1214 microversion: 2.1 time: 0.078876 Jul 21 21:02:14.160950 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 438/876] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:14 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:14.363461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:14.364292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:14.372639 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:14.373218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:14.374224 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:14.374732 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:14.555800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:14.566944 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:14.569150 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:14.570773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7acd84bf-847f-4d47-a107-e3d4e05d9d39 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.213833 Jul 21 21:02:14.571751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 439/877] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:14 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:15.177463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:15.178174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:15.184848 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:15.185376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:15.186220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:15.186739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:15.263589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:15.273342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8d9f2565-45ee-4487-a9b1-065513e6aa6a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1274 microversion: 2.1 time: 0.099742 Jul 21 21:02:15.275037 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 439/878] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:15 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:15.590008 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:15.590773 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:15.601116 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:15.601816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:15.602777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:15.603214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:15.664787 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-193301278", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfa25da3-fc72-46d1-8f85-10482d1b770c"}], "security_groups": [{"name": "tempest-securitygroup--1275691043"}], "key_name": "tempest-keypair-1994963326", "user_data": "}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:15.765695 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] validate_networks() for [('cfa25da3-fc72-46d1-8f85-10482d1b770c', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:02:15.802116 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:15.811064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:15.812685 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:15.814081 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-aad26fb9-a6c0-430b-bba7-052f43de4d1c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.228027 Jul 21 21:02:15.815142 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 440/879] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:15 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:16.148256 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:02:16.148688 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:02:16.149173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:02:16.149590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:02:16.150005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:02:16.159024 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:16.159549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:16.160458 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:16.160924 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:16.179813 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for project c51d3542adae4062a487ab85d673140d. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:02:16.184278 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Getting quotas for user ab2bc1eb1eb845ec82b79adee04a51e7 and project c51d3542adae4062a487ab85d673140d. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:02:16.195698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:02:16.198322 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:02:16.249043 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-68d54600-1a4d-498a-96f4-6b6503d4ce66 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589015 Jul 21 21:02:16.249888 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 440/880] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:02:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 21:02:16.261400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3f08b010-8fb8-4027-a82d-e5666a556e20 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:16.262044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3f08b010-8fb8-4027-a82d-e5666a556e20 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:16.291126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:16.291812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:16.298570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:16.299103 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:16.299982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:16.300493 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:16.352166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3f08b010-8fb8-4027-a82d-e5666a556e20 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:16.364076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3f08b010-8fb8-4027-a82d-e5666a556e20 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1237 microversion: 2.1 time: 0.107807 Jul 21 21:02:16.365057 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 441/881] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:16 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:16.457710 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:16.467106 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2472b498-7b2e-4a27-b611-beb1e9ec60c3 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.180751 Jul 21 21:02:16.468019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 441/882] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:16 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:16.815118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-f22580d7-3fdb-4979-88f0-d9486d0ec82e req-8d508a85-46d3-4893-ab18-04d863dc9cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19396e1c-4dd5-4a1c-8c6b-704de7663ce7", "tag": "bda79a3b-4f65-45a3-86e9-61e48b90ff58"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:16.824296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-f22580d7-3fdb-4979-88f0-d9486d0ec82e req-8d508a85-46d3-4893-ab18-04d863dc9cb9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:16.824760 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-f22580d7-3fdb-4979-88f0-d9486d0ec82e req-8d508a85-46d3-4893-ab18-04d863dc9cb9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:16.832691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:16.833900 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:16.838808 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-f22580d7-3fdb-4979-88f0-d9486d0ec82e req-8d508a85-46d3-4893-ab18-04d863dc9cb9 service nova] Creating event network-changed:bda79a3b-4f65-45a3-86e9-61e48b90ff58 for instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 on hv-cinder-85068 Jul 21 21:02:16.842179 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:16.842737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:16.843671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:16.843814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-f22580d7-3fdb-4979-88f0-d9486d0ec82e req-8d508a85-46d3-4893-ab18-04d863dc9cb9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032348 Jul 21 21:02:16.844298 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:16.844890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 442/883] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:16.996031 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:17.003934 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:17.005990 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:17.007151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d3323842-e9c8-480f-9c19-0d7e12127255 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.178654 Jul 21 21:02:17.007707 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 442/884] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:16 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:17.382272 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:17.382965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:17.389177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:17.389631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:17.390406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:17.390843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:17.485347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:17.486675 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:17.498700 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:17.499604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:17.500652 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:17.501297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:17.667149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:17.675084 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ca43b08a-ec38-4ce3-a6bb-b332fc24dddb tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.193582 Jul 21 21:02:17.675683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 443/885] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:17 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:17.721609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:17.729863 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-eedcac87-d843-4564-aea8-474d3fc7e115 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1297 microversion: 2.1 time: 0.351954 Jul 21 21:02:17.730433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 443/886] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:17 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1297 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:18.025103 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:18.025717 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:18.031846 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:18.032302 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:18.033076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:18.033519 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:18.163644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:18.172325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:18.173895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:18.175125 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a20613e0-0bda-48a8-847f-01de427e3837 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.154671 Jul 21 21:02:18.175747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 444/887] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:18 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:18.692001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:18.693414 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:18.700274 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:18.700723 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:18.701496 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:18.701955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:18.750114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:18.751107 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:18.760585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:18.761046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:18.761833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:18.762275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:18.840733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:18.848684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4092ec2a-b6f9-41b0-b0f8-183e81e37d40 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.160541 Jul 21 21:02:18.850192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 444/888] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:18 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:18.903043 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:18.910757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-894cc57c-b195-42ba-978f-ff648b15e25b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.167044 Jul 21 21:02:18.911924 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 445/889] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:18 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:19.193927 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:19.194445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:19.201234 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:19.201722 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:19.202860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:19.203617 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:19.355004 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:19.362940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:19.364614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:19.366047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-15fcc4f0-0766-406d-a0eb-a5a9c9d0d2e7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.176479 Jul 21 21:02:19.366606 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 445/890] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:19 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:19.866618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:19.867293 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:19.873874 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:19.874331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:19.875102 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:19.875548 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:19.928867 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:19.929463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:19.936044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:19.936497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:19.937268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:19.937707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:20.010920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:20.019024 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d285852d-814a-4207-b2c7-24328fb7b135 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.156371 Jul 21 21:02:20.019340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 446/891] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:19 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:20.077800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:20.085754 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5a81346c-2b76-4013-a08b-d1683da8b202 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.161161 Jul 21 21:02:20.086321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 446/892] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:19 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:20.384810 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:20.385456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:20.388347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:20.392236 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:20.392691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:20.393469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:20.393912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:20.522919 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:20.531109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:20.532682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:20.533851 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-519e65f1-37bf-4e49-bcf6-28dfc4361ce4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.153515 Jul 21 21:02:20.534426 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 447/893] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:20 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:21.034332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:21.034947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:21.042161 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:21.042867 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:21.043856 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:21.044455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:21.103091 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:21.104386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:21.110778 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:21.111155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:21.111956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:21.112569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:21.250115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:21.258406 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cd51449b-4d0a-49e8-9ec4-067fb7a9b166 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.159803 Jul 21 21:02:21.259369 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 448/894] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:21 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:21.288056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:21.295440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-eb415467-6e7d-42fe-997a-9de7a40e2fef tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.264875 Jul 21 21:02:21.296033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 447/895] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:21 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:21.567586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:21.568632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:21.578596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:21.579386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:21.580474 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:21.581110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:21.619297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-6de0f1ea-f16e-4677-92d9-00a214eb7dc3 req-64a2e7f3-40f5-4d39-90fc-f58a329679d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012d5bba-82b3-4bf8-b491-d700fcf78cef", "tag": "afce5e52-2f26-4fa4-947d-b22c511e5dd9"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:21.632685 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:21.640538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-6de0f1ea-f16e-4677-92d9-00a214eb7dc3 req-64a2e7f3-40f5-4d39-90fc-f58a329679d7 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:21.641160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-6de0f1ea-f16e-4677-92d9-00a214eb7dc3 req-64a2e7f3-40f5-4d39-90fc-f58a329679d7 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:21.678836 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-6de0f1ea-f16e-4677-92d9-00a214eb7dc3 req-64a2e7f3-40f5-4d39-90fc-f58a329679d7 service nova] Creating event network-changed:afce5e52-2f26-4fa4-947d-b22c511e5dd9 for instance 012d5bba-82b3-4bf8-b491-d700fcf78cef on hv-cinder-85068 Jul 21 21:02:21.687572 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-6de0f1ea-f16e-4677-92d9-00a214eb7dc3 req-64a2e7f3-40f5-4d39-90fc-f58a329679d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072211 Jul 21 21:02:21.688268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 448/896] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:02:21.735041 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:21.743855 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:21.745503 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:21.746761 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-86d5ee25-ff90-4922-9290-999419bdc55d tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.198076 Jul 21 21:02:21.747393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 449/897] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:21 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:22.276037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:22.276697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:22.283142 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:22.283596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:22.284392 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:22.284833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:22.313879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:22.315159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:22.322289 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:22.322736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:22.323501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:22.323980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:22.456327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:22.463829 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-98d7aa2d-b7c4-4500-9b8e-e2398d498cda tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.153759 Jul 21 21:02:22.464409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 450/898] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:22 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:22.501050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:22.509734 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b4c306b6-99ba-4c70-aa24-06871f4b9488 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.238433 Jul 21 21:02:22.510281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 449/899] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:22 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:22.765117 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:22.765757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:22.773194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:22.773644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:22.774430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:22.774948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:22.909617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:22.918958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:22.920600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:22.921733 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f85afaea-41d3-45ae-86e1-7cfaa103c394 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1744 microversion: 2.20 time: 0.160507 Jul 21 21:02:22.922600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 451/900] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:22 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:23.119702 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-924080db-94cf-4b80-8868-1388b28f1e1b req-0596c6eb-c22a-425d-9f4d-692f4a7af8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19396e1c-4dd5-4a1c-8c6b-704de7663ce7", "name": "network-vif-plugged", "status": "completed", "tag": "bda79a3b-4f65-45a3-86e9-61e48b90ff58"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:23.129207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-924080db-94cf-4b80-8868-1388b28f1e1b req-0596c6eb-c22a-425d-9f4d-692f4a7af8d3 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:23.129876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-924080db-94cf-4b80-8868-1388b28f1e1b req-0596c6eb-c22a-425d-9f4d-692f4a7af8d3 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:23.142265 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-924080db-94cf-4b80-8868-1388b28f1e1b req-0596c6eb-c22a-425d-9f4d-692f4a7af8d3 service nova] Creating event network-vif-plugged:bda79a3b-4f65-45a3-86e9-61e48b90ff58 for instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 on hv-cinder-85068 Jul 21 21:02:23.147223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-924080db-94cf-4b80-8868-1388b28f1e1b req-0596c6eb-c22a-425d-9f4d-692f4a7af8d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Jul 21 21:02:23.147828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 450/901] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:23.481047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:23.481661 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:23.488169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:23.488618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:23.490018 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:23.490715 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:23.527314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:23.528044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:23.534319 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:23.534767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:23.535538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:23.536006 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:23.620404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:23.628022 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d51d7fa4-1c5a-46c6-974e-b15e9c9d951d tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.150883 Jul 21 21:02:23.628603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 452/902] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:23 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:23.667144 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:23.674618 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-55ef8558-6679-4634-b140-981cb5de6e79 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.151919 Jul 21 21:02:23.675175 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 451/903] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:23 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:23.941391 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:23.941919 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:23.947862 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:23.948298 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:23.949049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:23.949483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:23.967438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:24.082072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:24.090570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:24.092090 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:24.093244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-950e42b6-15fd-47ab-8c84-a3c5cd821c30 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1744 microversion: 2.20 time: 0.155913 Jul 21 21:02:24.093818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 453/904] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:23 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:24.647798 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:24.649112 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:24.655777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:24.656233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:24.657013 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:24.657453 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:24.691375 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:24.692100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:24.699194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:24.699639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:24.700492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:24.700926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:24.794158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:24.801653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e15be72f-8cd7-438c-80cc-dccfef23c956 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.159419 Jul 21 21:02:24.803220 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 452/905] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:24 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:24.832048 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:24.839312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-68ffed3c-88bc-4d6d-9712-b0056411eeda tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.151888 Jul 21 21:02:24.839908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 454/906] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:24 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:25.112025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:25.112727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:25.119117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:25.119568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:25.120386 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:25.120824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:25.257317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:25.265207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:25.266810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:25.267976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e165e472-8f87-4f30-a738-b3ccd5b8e056 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1744 microversion: 2.20 time: 0.159905 Jul 21 21:02:25.268536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 453/907] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:25 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:25.819378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:25.819916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:25.826346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:25.826787 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:25.827574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:25.828049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:25.855959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:25.856571 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:25.863505 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:25.863988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:25.865361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:25.866055 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:25.959121 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:25.966616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5cf0f50e-2bbd-47a9-a1ca-9714471b14cc tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.151229 Jul 21 21:02:25.967359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 455/908] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:25 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:25.996305 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:26.003780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a9fa0b21-4270-4276-8551-49b75d4712c0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.151556 Jul 21 21:02:26.004346 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 454/909] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:25 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:26.286265 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:26.287069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:26.289475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=4 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:26.290275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=14 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:26.296171 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:26.296613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:26.297372 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:26.297801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:26.425660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:26.433735 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:26.435223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:26.436418 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-3642c826-839d-4a49-b53c-f08abf8ec615 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1744 microversion: 2.20 time: 0.154192 Jul 21 21:02:26.437216 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 456/910] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:26 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:26.984051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:26.984669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:26.987695 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:26.993123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:26.993578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:26.994351 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:26.994789 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:27.020830 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:27.021659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:27.028593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:27.029165 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:27.030012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:27.030531 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:27.170618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:27.179757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-325d0ae6-9309-4dc4-b450-cbc6e67d7482 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.162750 Jul 21 21:02:27.180570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 457/911] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:27 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:27.192824 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:27.202117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-869d5854-4ebe-46d1-8062-fb6bef51051e tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.221096 Jul 21 21:02:27.210969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 455/912] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:26 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:27.396221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-703be870-25c7-4f3c-8e4c-f23bfaaeee15 req-eacb858d-a81c-43b9-8142-46e94001f981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4fa343-16d7-4f75-a3e3-3abef4456ed6", "name": "network-vif-plugged", "status": "completed", "tag": "4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:27.404604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-703be870-25c7-4f3c-8e4c-f23bfaaeee15 req-eacb858d-a81c-43b9-8142-46e94001f981 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:27.405053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-703be870-25c7-4f3c-8e4c-f23bfaaeee15 req-eacb858d-a81c-43b9-8142-46e94001f981 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:27.421795 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-703be870-25c7-4f3c-8e4c-f23bfaaeee15 req-eacb858d-a81c-43b9-8142-46e94001f981 service nova] Creating event network-vif-plugged:4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8 for instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 on hv-cinder-85068 Jul 21 21:02:27.427582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-703be870-25c7-4f3c-8e4c-f23bfaaeee15 req-eacb858d-a81c-43b9-8142-46e94001f981 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035198 Jul 21 21:02:27.428252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 458/913] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:27.454367 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:27.454898 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:27.461106 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:27.461555 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:27.462321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:27.462760 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:27.467813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:27.596198 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:27.604452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:27.605962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:27.607123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-363250e5-7cd6-492c-9991-c2c8c711b150 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1744 microversion: 2.20 time: 0.156708 Jul 21 21:02:27.607695 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 456/914] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:27 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:28.198033 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:28.200047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:28.208213 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:28.208735 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:28.209520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:28.209960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:28.219589 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:28.220401 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:28.227230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:28.227664 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:28.228463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:28.228890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:28.371502 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:28.379264 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b24f8ac3-6d65-4059-a63d-43283994b12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1314 microversion: 2.1 time: 0.164397 Jul 21 21:02:28.379891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 457/915] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:28 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:28.464219 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:28.471586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f8b29ee1-59b8-4fec-a450-4c208d15ce7a tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.279207 Jul 21 21:02:28.472183 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 459/916] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:28 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:28.625315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:28.625934 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:28.631989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:28.632442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:28.633210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:28.633648 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:28.813215 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:28.821996 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:28.823502 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:28.824694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-965a30e5-a456-4fa8-8ff5-7469c8b5dcce tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1744 microversion: 2.20 time: 0.203274 Jul 21 21:02:28.825255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 458/917] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:28 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:29.396904 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:29.397538 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:29.404229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:29.404680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:29.405458 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:29.405905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:29.488365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:29.489003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:29.497291 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:29.497751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:29.498556 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:29.498991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:29.544123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:29.551586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-22f93f6b-8944-40c9-8927-566d50a966c7 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1497 microversion: 2.1 time: 0.158582 Jul 21 21:02:29.561701 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 460/918] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:29 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:29.631878 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:29.639567 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-090ca874-3c85-4b6b-963c-689acad9044d tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.155102 Jul 21 21:02:29.640210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 459/919] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:29 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:29.813542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-f86b189d-5450-4aac-9693-b588c178d740 req-1c05f664-e10a-466a-a824-b000d0e997d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012d5bba-82b3-4bf8-b491-d700fcf78cef", "name": "network-vif-plugged", "status": "completed", "tag": "afce5e52-2f26-4fa4-947d-b22c511e5dd9"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:29.822625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-f86b189d-5450-4aac-9693-b588c178d740 req-1c05f664-e10a-466a-a824-b000d0e997d3 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:29.823734 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-f86b189d-5450-4aac-9693-b588c178d740 req-1c05f664-e10a-466a-a824-b000d0e997d3 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:29.837870 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-f86b189d-5450-4aac-9693-b588c178d740 req-1c05f664-e10a-466a-a824-b000d0e997d3 service nova] Creating event network-vif-plugged:afce5e52-2f26-4fa4-947d-b22c511e5dd9 for instance 012d5bba-82b3-4bf8-b491-d700fcf78cef on hv-cinder-85068 Jul 21 21:02:29.845839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-f86b189d-5450-4aac-9693-b588c178d740 req-1c05f664-e10a-466a-a824-b000d0e997d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036280 Jul 21 21:02:29.847132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 461/920] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:29.849877 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:29.852763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:29.857786 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:29.858286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:29.859076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:29.859517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:30.007962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:30.015991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:30.017554 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:30.018753 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-123a0c57-8ece-4b85-8b0e-cefed0148912 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1744 microversion: 2.20 time: 0.177458 Jul 21 21:02:30.019387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 460/921] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:29 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:30.099301 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:30.099926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:30.106663 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:30.107119 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:30.108104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:30.108546 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:30.137466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Going to try to terminate instance {{(pid=124647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:02:30.225931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-33a58ae2-db6d-48aa-9f0c-b17dc3e85c90 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "DELETE /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 204 len: 0 microversion: 2.1 time: 0.130234 Jul 21 21:02:30.227101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 462/922] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:02:30 2022] DELETE /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:02:30.235249 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:30.235977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:30.242867 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:30.243322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:30.244143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:30.244742 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:30.386635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:30.394387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b109384a-bfda-41da-9b84-2f4d4c85771a tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1503 microversion: 2.1 time: 0.162973 Jul 21 21:02:30.394962 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 461/923] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:30 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:30.660090 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:30.662160 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:30.669301 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:30.669980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:30.670997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:30.672230 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:30.824096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:30.832531 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7e74d7dc-0502-4490-ac3e-e58b038e6ff7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.177084 Jul 21 21:02:30.833936 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 463/924] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:30 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:31.038787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:31.040093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:31.047065 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:31.047534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:31.048444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:31.049075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:31.191761 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:31.202114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:31.204499 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:31.205903 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f67f173c-48de-4a96-b6d0-a8443d544088 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.171585 Jul 21 21:02:31.206951 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 462/925] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:31 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:31.412573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:31.413329 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:31.424509 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:31.424961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:31.425745 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:31.426224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:31.567129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:31.577033 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7f33585d-d15c-44d9-a9f2-0f8f4b636a00 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1503 microversion: 2.1 time: 0.168242 Jul 21 21:02:31.577692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 464/926] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:31 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:31.850484 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:31.851262 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:31.858749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:31.859276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:31.860363 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:31.860871 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:32.019577 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:32.029910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-63f8dde4-9f79-4c98-be62-b46d422a090c tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.184027 Jul 21 21:02:32.030517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 463/927] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:31 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:32.232774 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:32.233321 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:32.241131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:32.241579 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:32.242344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:32.242779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:32.384858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:32.393512 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:32.395056 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:32.403888 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-71560d8b-3d1c-4718-86d1-aa61e83c6cf7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.175258 Jul 21 21:02:32.420481 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 465/928] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:32 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:32.594576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:32.595314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:32.602984 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:32.603513 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:32.604886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:32.604886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:32.769023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:32.779181 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3ace8ea0-e3bf-4aec-ae71-f5a7315c6a7f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1503 microversion: 2.1 time: 0.188570 Jul 21 21:02:32.788060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 464/929] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:32 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:33.048417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:33.049234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:33.061254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:33.061705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:33.062487 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:33.062922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:33.253603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:33.262574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f7a451a2-4d6c-46e1-8c67-11b626ebd29f tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1363 microversion: 2.1 time: 0.218622 Jul 21 21:02:33.263186 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 466/930] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:33 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:02:33.423546 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:33.424307 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:33.445133 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:33.445988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:33.447368 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:33.448386 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:33.799238 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:33.800066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:33.808751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:33.809274 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:33.809452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:33.810069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:33.810533 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:33.823449 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:33.825005 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:33.826202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e1778148-d461-4fe0-9430-9ecf13130bc7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.407737 Jul 21 21:02:33.826950 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 465/931] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:33 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:33.890759 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356d7835faeb4ea09cf7580f5f467473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bf599415154f1eb8ebdf982099e635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:33.912632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5de1ad82-42f2-4199-b058-8f3f4951e12f tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 200 len: 1461 microversion: 2.1 time: 0.113016 Jul 21 21:02:33.917131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 467/932] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:33 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 1461 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:34.010833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-96cdf478-38a0-4aff-95cd-b61c942dee4f req-e0e55b41-b7ab-42f1-92a5-f4395a01cf46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19396e1c-4dd5-4a1c-8c6b-704de7663ce7", "name": "network-vif-deleted", "tag": "bda79a3b-4f65-45a3-86e9-61e48b90ff58"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:34.027455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-96cdf478-38a0-4aff-95cd-b61c942dee4f req-e0e55b41-b7ab-42f1-92a5-f4395a01cf46 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.028387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-96cdf478-38a0-4aff-95cd-b61c942dee4f req-e0e55b41-b7ab-42f1-92a5-f4395a01cf46 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.041796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-96cdf478-38a0-4aff-95cd-b61c942dee4f req-e0e55b41-b7ab-42f1-92a5-f4395a01cf46 service nova] Creating event network-vif-deleted:bda79a3b-4f65-45a3-86e9-61e48b90ff58 for instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 on hv-cinder-85068 Jul 21 21:02:34.047593 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-96cdf478-38a0-4aff-95cd-b61c942dee4f req-e0e55b41-b7ab-42f1-92a5-f4395a01cf46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040371 Jul 21 21:02:34.048677 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 466/933] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:34.282270 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:34.282866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:34.290139 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.290582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.291353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.291956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.445590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:34.455877 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e35b8367-fe16-4bc4-b990-20fdf04e9406 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1549 microversion: 2.1 time: 0.177848 Jul 21 21:02:34.467618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 468/934] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:34 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:02:34.473718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e944176e-bb9b-4ac8-be23-666797cacb56 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:34.474758 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e944176e-bb9b-4ac8-be23-666797cacb56 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:34.484122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e944176e-bb9b-4ac8-be23-666797cacb56 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.484794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e944176e-bb9b-4ac8-be23-666797cacb56 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.485650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e944176e-bb9b-4ac8-be23-666797cacb56 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.486255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e944176e-bb9b-4ac8-be23-666797cacb56 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.600311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e944176e-bb9b-4ac8-be23-666797cacb56 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130817 Jul 21 21:02:34.600996 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 467/935] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 21:02:34 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:02:34.844912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:34.845618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:34.858001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.859065 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.859961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.860405 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.934436 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:34.935788 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] [instance: 19396e1c-4dd5-4a1c-8c6b-704de7663ce7] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:34.946180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.947816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.949323 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:34.949859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:34.972326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] HTTP exception thrown: Instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 could not be found. Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Request method failure captured: Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 HTTP/1.1 Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b7Bd4kQY6ICEu9dfhz_Eh7_SMahRvkdctim24zF_aUOZtoIRKMURVvKLG_JF1PLiLQ-pE4-HAF6M0HvcLl1k_diXcnViysElyxlqlGVaNHKVhKGT-EA61lpwip4-9OHY1x6UpXCMYBbLUbnFGCj-H1abytFEBKQwF3-yczv7yC03nM Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 99bf599415154f1eb8ebdf982099e635 Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesActionsTest-1993371441 Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:02:34.974610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99bf599415154f1eb8ebdf982099e635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99bf599415154f1eb8ebdf982099e635"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99bf599415154f1eb8ebdf982099e635"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99bf599415154f1eb8ebdf982099e635"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesActionsTest-1993371441 Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 99bf599415154f1eb8ebdf982099e635 Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesActionsTest-1993371441 Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesActionsTest-1993371441-project Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 356d7835faeb4ea09cf7580f5f467473 Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesActionsTest-1993371441-project Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 could not be found. Jul 21 21:02:34.976244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '19396e1c-4dd5-4a1c-8c6b-704de7663ce7'} Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 could not be found. Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:02:34.977025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 could not be found. Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 could not be found. Jul 21 21:02:34.978286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:02:34.980807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] Returning 404 to user: Instance 19396e1c-4dd5-4a1c-8c6b-704de7663ce7 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:02:34.981896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-01a70e95-75bf-4516-9078-481a8be50309 tempest-VolumesActionsTest-1993371441 tempest-VolumesActionsTest-1993371441-project] 10.222.0.60 "GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7" status: 404 len: 111 microversion: 2.1 time: 0.052217 Jul 21 21:02:34.982969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 468/936] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:02:34 2022] GET /compute/v2.1/servers/19396e1c-4dd5-4a1c-8c6b-704de7663ce7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:02:35.041385 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:35.045451 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:35.055901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:35.058200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:35.059746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2e33d0f5-e4d1-483c-9c67-b4870899c24c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.218830 Jul 21 21:02:35.071431 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 469/937] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:34 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:36.069324 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-271d8f1f-42f8-4e03-a6fe-89a7a9a31d55 req-cf7c8d47-ac26-4f72-a180-539cba95710a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012d5bba-82b3-4bf8-b491-d700fcf78cef", "tag": "afce5e52-2f26-4fa4-947d-b22c511e5dd9"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:36.079446 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-271d8f1f-42f8-4e03-a6fe-89a7a9a31d55 req-cf7c8d47-ac26-4f72-a180-539cba95710a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:36.080326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-271d8f1f-42f8-4e03-a6fe-89a7a9a31d55 req-cf7c8d47-ac26-4f72-a180-539cba95710a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:36.082679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:36.084628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:36.094647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:36.095512 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:36.096969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:36.097707 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:36.098756 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-271d8f1f-42f8-4e03-a6fe-89a7a9a31d55 req-cf7c8d47-ac26-4f72-a180-539cba95710a service nova] Creating event network-changed:afce5e52-2f26-4fa4-947d-b22c511e5dd9 for instance 012d5bba-82b3-4bf8-b491-d700fcf78cef on hv-cinder-85068 Jul 21 21:02:36.106976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-271d8f1f-42f8-4e03-a6fe-89a7a9a31d55 req-cf7c8d47-ac26-4f72-a180-539cba95710a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042985 Jul 21 21:02:36.108575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 469/938] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:02:36.304492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:36.330910 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:36.332780 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:36.338410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1c541228-4bf6-4204-8b08-d06cd2b25053 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.261928 Jul 21 21:02:36.349919 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 470/939] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:36 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:37.359214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:37.360498 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:37.370881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:37.371354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:37.372485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:37.373092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:37.533963 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:37.543700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:37.545379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:37.547069 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b348c9d4-a7d8-47bd-b925-f54deb5e4e5b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.192801 Jul 21 21:02:37.547863 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 470/940] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:37 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:38.570654 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:38.571267 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:38.579694 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:38.580169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:38.580978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:38.581398 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:38.729924 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:38.738319 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:38.739915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:38.741428 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a2163ad5-1499-4411-995a-e0b6d9c535a9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.178529 Jul 21 21:02:38.742422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 471/941] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:38 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:39.761011 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:39.761656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:39.768705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:39.769161 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:39.769974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:39.770970 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:40.058210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:40.066764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:40.069470 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:40.070665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4092ecda-57a4-4404-b449-0dab22fbf553 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.313746 Jul 21 21:02:40.071227 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 471/942] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:39 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:41.089716 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:41.090326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:41.096959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:41.097410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:41.098203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:41.099383 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:41.229053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:41.236962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:41.238468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:41.239801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f0537d5a-9483-409d-9817-75be3b15244f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1739 microversion: 2.20 time: 0.154002 Jul 21 21:02:41.240366 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 472/943] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:41 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:42.260444 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:42.261477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:42.270173 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:42.270976 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:42.272410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:42.273409 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:42.444044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:42.455816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:42.458116 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:42.460544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-42591293-43c5-4fbb-8698-ea8a9857c145 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1721 microversion: 2.20 time: 0.206035 Jul 21 21:02:42.461241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 472/944] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:42 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:43.481103 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:43.482802 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:43.493886 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:43.494858 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:43.495910 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:43.496523 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:43.678660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:43.691189 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:43.694379 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:43.697155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d3ea8036-c86b-4539-95bd-213cc501e689 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1721 microversion: 2.20 time: 0.220998 Jul 21 21:02:43.697626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 473/945] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:43 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:44.895114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:44.895881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:44.903040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:44.903040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:44.903908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:44.904635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:45.068079 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:45.082833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:45.085474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:45.087305 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2b498acf-7560-434a-87fd-84758bdcc0e3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1724 microversion: 2.20 time: 0.375127 Jul 21 21:02:45.088663 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 473/946] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:44 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:45.109047 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-048ce312-bdc3-4135-ac8d-cb05f1a5495a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5834edc-c730-49e1-b51f-13b11934e745"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:45.110373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-048ce312-bdc3-4135-ac8d-cb05f1a5495a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:45.124184 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-048ce312-bdc3-4135-ac8d-cb05f1a5495a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:45.124545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-048ce312-bdc3-4135-ac8d-cb05f1a5495a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:45.125377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-048ce312-bdc3-4135-ac8d-cb05f1a5495a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:45.127995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-048ce312-bdc3-4135-ac8d-cb05f1a5495a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:45.474453 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-048ce312-bdc3-4135-ac8d-cb05f1a5495a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.369372 Jul 21 21:02:45.475290 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 474/947] 10.222.0.60 () {62 vars in 1363 bytes} [Thu Jul 21 21:02:45 2022] POST /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-volume_attachments => generated 188 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:02:45.624098 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ef68baf8-f0e2-48a9-b118-55a31f53f5a7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:45.625062 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ef68baf8-f0e2-48a9-b118-55a31f53f5a7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:45.634440 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ef68baf8-f0e2-48a9-b118-55a31f53f5a7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:45.635140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ef68baf8-f0e2-48a9-b118-55a31f53f5a7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:45.636241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ef68baf8-f0e2-48a9-b118-55a31f53f5a7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:45.636870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ef68baf8-f0e2-48a9-b118-55a31f53f5a7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:45.760264 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:45.852018 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-cf86cf75-860c-4ce9-a98c-88b454352bb1 req-68791b17-ba8b-4f7b-a2fd-1a0b9133b925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4fa343-16d7-4f75-a3e3-3abef4456ed6", "name": "network-vif-unplugged", "status": "completed", "tag": "4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:45.861456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-cf86cf75-860c-4ce9-a98c-88b454352bb1 req-68791b17-ba8b-4f7b-a2fd-1a0b9133b925 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:45.862459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-cf86cf75-860c-4ce9-a98c-88b454352bb1 req-68791b17-ba8b-4f7b-a2fd-1a0b9133b925 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:45.878616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.compute.server_external_events [req-cf86cf75-860c-4ce9-a98c-88b454352bb1 req-68791b17-ba8b-4f7b-a2fd-1a0b9133b925 service nova] Unable to find a host for instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6. Dropping event network-vif-unplugged {{(pid=124647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 21:02:45.879818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-cf86cf75-860c-4ce9-a98c-88b454352bb1 req-68791b17-ba8b-4f7b-a2fd-1a0b9133b925 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033024 Jul 21 21:02:45.884468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 475/948] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 21 21:02:45.981400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ef68baf8-f0e2-48a9-b118-55a31f53f5a7 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-volume_attachments/b5834edc-c730-49e1-b51f-13b11934e745" status: 202 len: 0 microversion: 2.20 time: 0.365460 Jul 21 21:02:45.983821 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 474/949] 10.222.0.60 () {60 vars in 1456 bytes} [Thu Jul 21 21:02:45 2022] DELETE /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-volume_attachments/b5834edc-c730-49e1-b51f-13b11934e745 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:02:46.046556 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4c91011d-2c4a-4d1b-9bae-1260e75db527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:02:46.047391 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4c91011d-2c4a-4d1b-9bae-1260e75db527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:46.054623 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c91011d-2c4a-4d1b-9bae-1260e75db527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:46.055275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c91011d-2c4a-4d1b-9bae-1260e75db527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:46.056240 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c91011d-2c4a-4d1b-9bae-1260e75db527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:46.056825 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4c91011d-2c4a-4d1b-9bae-1260e75db527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:46.216653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4c91011d-2c4a-4d1b-9bae-1260e75db527 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "POST /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/action" status: 202 len: 0 microversion: 2.20 time: 0.173635 Jul 21 21:02:46.218537 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 476/950] 10.222.0.60 () {62 vars in 1318 bytes} [Thu Jul 21 21:02:46 2022] POST /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:02:46.229359 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:46.230042 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:46.246175 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:46.247431 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:46.250587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:46.252315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:46.593986 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:46.606190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:46.608076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:46.609780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3397f94c-f8c8-44fb-b118-8c9155fd30f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1672 microversion: 2.20 time: 0.387203 Jul 21 21:02:46.621822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 475/951] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:46 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1672 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:47.631610 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:47.632356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:47.650529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:47.651517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:47.652632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:47.653209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:47.843478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:47.858327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:47.860865 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:47.862143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-89de9465-4484-449c-a63b-504a65ee0f96 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.235540 Jul 21 21:02:47.874867 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 477/952] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:47 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:48.897623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:48.901587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:48.920839 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:48.923438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:48.925647 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:48.932432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:49.262900 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:49.275475 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:49.289094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:49.290471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-922ee00f-fbe3-4905-9888-3dc9e1e36708 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.406709 Jul 21 21:02:49.308118 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 476/953] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:48 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:50.310995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:50.312583 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:50.320541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:50.321355 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:50.322536 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:50.323080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:50.533340 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:50.543422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:50.544974 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:50.546169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-217de445-5c62-429f-8f40-d01b956e1c6a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.239276 Jul 21 21:02:50.557770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 478/954] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:50 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:51.565317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:51.566722 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:51.575095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:51.576121 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:51.577415 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:51.578149 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:51.747377 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:51.758749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:51.760280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:51.761452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1bfcfbbe-4cfb-48d5-aa84-d09871f3f18a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.200397 Jul 21 21:02:51.762314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 477/955] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:51 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:52.782555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:52.783155 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:52.789922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:52.791483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:52.791959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:52.792734 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:52.793267 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:53.041294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:53.053538 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:53.056128 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:53.057339 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1d2e21ca-be18-4974-bebb-cbbd2b793ca9 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.279028 Jul 21 21:02:53.058225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 479/956] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:52 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:54.075567 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:54.076400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:54.078753 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=59 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:02:54.085735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:54.086334 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:54.086939 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:54.087383 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:54.315387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:54.324810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:54.326543 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:54.327853 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6fb0089d-2608-444e-b0ae-49eb059003f8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.256127 Jul 21 21:02:54.328493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 478/957] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:54 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:02:55.347987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:55.348770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:55.359054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:55.359054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:55.359054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:55.359054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:55.592164 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:55.603207 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:55.604665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:55.605876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-33cd741d-2c82-4bef-99cf-f3be0d873f4a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.261935 Jul 21 21:02:55.617853 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 480/958] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:55 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:56.625131 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:56.626518 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:56.634397 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:56.634939 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:56.635819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:56.636337 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:56.836294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:56.845183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:56.847191 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:56.848786 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b189c433-bb55-4c1e-8e7d-3cc12dd48c54 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.227617 Jul 21 21:02:56.849769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 479/959] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:56 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:57.867307 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:57.868009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:57.875254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:57.875856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:57.876650 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:57.877100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:58.028969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:58.038142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:58.039656 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:58.040856 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2561cb03-416d-467b-ade9-b644168764bd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.178297 Jul 21 21:02:58.041466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 481/960] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:57 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:02:59.061931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:02:59.062868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:02:59.071487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:59.071968 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:59.072734 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:02:59.073163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:02:59.226921 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:59.235512 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:59.237977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:02:59.239152 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-641af187-199b-4442-82a8-2f4800ccf668 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.182357 Jul 21 21:02:59.251971 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 480/961] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:02:59 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:00.259665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:00.260343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:00.267145 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:00.267695 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:00.268516 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:00.268966 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:00.402588 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:00.410605 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:00.412207 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:00.413494 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1a6f7e6d-9a5b-4f89-a66f-f6bb9d64196a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.158572 Jul 21 21:03:00.414381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 482/962] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:00 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:01.432184 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:01.432806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:01.439857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:01.440313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:01.441120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:01.441583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:01.575889 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:01.583847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:01.585363 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:01.586521 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-98d9eb13-0ef6-45de-8424-f9b77e65861f tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.158735 Jul 21 21:03:01.587087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 481/963] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:01 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:03:02.604783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:02.605587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:02.612876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:02.613426 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:02.614294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:02.614808 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:02.639751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:02.852566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:02.863646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:02.867113 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:02.869166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2356f7d4-0d46-4b12-8d56-939bbe9d1a88 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.268337 Jul 21 21:03:02.872945 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 483/964] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:02 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:03.892041 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:03.892656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:03.900148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:03.900596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:03.901364 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:03.902120 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:04.067932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:04.076918 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:04.079179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:04.080770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-83f71439-fb1b-4ef6-973a-c18d6658e5ae tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.192853 Jul 21 21:03:04.081923 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 482/965] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:03 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:05.103475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:05.105242 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:05.112885 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:05.113659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:05.114665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:05.116787 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:05.356101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:05.365166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:05.367652 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:05.369136 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-80c89c28-e638-423a-80d6-4706380f6596 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.273446 Jul 21 21:03:05.369785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 484/966] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:05 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:06.391967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:06.393124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:06.409075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:06.409642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:06.410437 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:06.410878 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:06.599060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:06.612986 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:06.614789 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:06.617390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-155d25b7-488f-48e2-90a9-d4241dc5c2f5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.232418 Jul 21 21:03:06.618204 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 483/967] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:06 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:07.636729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:07.637697 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:07.644079 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:07.644645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:07.645778 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:07.646436 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:07.911681 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:07.926496 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:07.937456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:07.938698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a025a122-994c-436b-ba75-c4c6f7ac83c8 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.306288 Jul 21 21:03:07.939273 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 485/968] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:07 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:08.089621 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-93d01f1c-c9b0-4e01-9caa-6be30d5d39cf req-fcc6c511-f1bc-47b2-ad04-95324a5c7ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4fa343-16d7-4f75-a3e3-3abef4456ed6", "name": "network-vif-plugged", "status": "completed", "tag": "4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:08.108469 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-93d01f1c-c9b0-4e01-9caa-6be30d5d39cf req-fcc6c511-f1bc-47b2-ad04-95324a5c7ed9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:08.109158 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-93d01f1c-c9b0-4e01-9caa-6be30d5d39cf req-fcc6c511-f1bc-47b2-ad04-95324a5c7ed9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:08.145420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-93d01f1c-c9b0-4e01-9caa-6be30d5d39cf req-fcc6c511-f1bc-47b2-ad04-95324a5c7ed9 service nova] Creating event network-vif-plugged:4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8 for instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 on hv-cinder-85068 Jul 21 21:03:08.155510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-93d01f1c-c9b0-4e01-9caa-6be30d5d39cf req-fcc6c511-f1bc-47b2-ad04-95324a5c7ed9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069417 Jul 21 21:03:08.156518 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 484/969] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:03:08.959993 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:08.960847 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:08.977488 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:08.978218 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:08.980615 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:08.981241 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:09.265600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:09.284903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:09.287063 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:09.289005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-008204b3-2530-47ef-9e92-1d34e1038996 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.335503 Jul 21 21:03:09.289802 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 486/970] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:08 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:10.308799 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:10.309508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:10.316614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:10.317330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:10.319147 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:10.319885 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:10.528879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:10.551125 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:10.554843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:10.558332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d6f2336e-850a-4d08-9d2b-4e1ffce6ef6c tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1730 microversion: 2.20 time: 0.253818 Jul 21 21:03:10.576325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 485/971] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:10 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:11.587987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:11.588746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:11.596180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:11.596634 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:11.597541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:11.597981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:11.811698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:11.821545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:11.823524 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:11.825252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9e534159-ed9e-428c-b77e-02c2af5f470b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1717 microversion: 2.20 time: 0.241343 Jul 21 21:03:11.826397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 487/972] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:03:11 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1717 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:03:20.269664 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2e920860-39a2-487c-937b-25c09423c04e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Action: 'create', calling method: .version_select at 0x7f35449f7550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1745406986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUzAQ2ER/wk3+9U019KLnTKAaTZ8puQs+aZskvZr54haBIdm4H4QZwNaqM5JoRySfc4G0ZyT/fk0545s+XgzP4NV6eGiHPbBQ0slTJafQXD13MTzlLvfWlLR19cROciOg=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:20.284298 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-2e920860-39a2-487c-937b-25c09423c04e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Getting quotas for project 6a26de2015bb4626ba4093aac7a3d085. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:03:20.288860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-2e920860-39a2-487c-937b-25c09423c04e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Getting quotas for user 084923b3deae41cd89c3935aed11a566 and project 6a26de2015bb4626ba4093aac7a3d085. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:03:20.310932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2e920860-39a2-487c-937b-25c09423c04e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045114 Jul 21 21:03:20.311508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 486/973] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 21:03:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:03:20.358763 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1827922485", "imageRef": "2c5a4fd5-7ef9-4d3f-92ee-85a336ca38bf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1745406986", "networks": [{"uuid": "a9e613c3-ca46-4d37-87a4-434109b70a16"}]}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:20.410188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] validate_networks() for [('a9e613c3-ca46-4d37-87a4-434109b70a16', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:03:20.788388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:03:20.788801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:03:20.789266 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:03:20.789666 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:03:20.790072 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:03:20.798854 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:20.799294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:20.800109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:20.800542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:20.816639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Getting quotas for project 6a26de2015bb4626ba4093aac7a3d085. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:03:20.820601 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Getting quotas for user 084923b3deae41cd89c3935aed11a566 and project 6a26de2015bb4626ba4093aac7a3d085. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:03:20.831167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:03:20.833328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c5a4fd5-7ef9-4d3f-92ee-85a336ca38bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:03:20.878328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ff4ceb39-0d12-44cf-989e-3e02d776be21 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523506 Jul 21 21:03:20.879280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 488/974] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:03:20.885896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:20.890549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b302debe-7444-49a1-8b79-e444edfbc163 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:20.891483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b302debe-7444-49a1-8b79-e444edfbc163 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:20.953656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b302debe-7444-49a1-8b79-e444edfbc163 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:20.962241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b302debe-7444-49a1-8b79-e444edfbc163 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1259 microversion: 2.1 time: 0.077135 Jul 21 21:03:20.962818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 487/975] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:20 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:21.980419 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:21.981021 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:21.987971 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:21.988423 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:21.989188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:21.989625 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:22.055463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:22.063627 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d19c359a-6b0f-4417-998a-cab7d301f656 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1311 microversion: 2.1 time: 0.087603 Jul 21 21:03:22.063627 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 489/976] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:21 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:03:23.080439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:23.081045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:23.088342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:23.088787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:23.089548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:23.089984 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:23.225764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:23.234420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0cff83b8-0017-4cfb-aa8d-d04666cb6fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.157815 Jul 21 21:03:23.234999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 488/977] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:23 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:24.252908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:24.253541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:24.255972 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:24.267029 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:24.267660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:24.268483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:24.268934 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:24.410225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:24.420940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-938cb418-bf6a-4c71-b04f-f2d82ac1f23f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.172364 Jul 21 21:03:24.421549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 490/978] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:24 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:25.438663 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:25.439277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:25.441630 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:25.447938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:25.448385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:25.449154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:25.449592 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:25.596733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:25.604500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c339c12e-a5e4-406e-8216-f90f380dbc75 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.169681 Jul 21 21:03:25.613642 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 489/979] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:25 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:26.622917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:26.623540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:26.630263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:26.630717 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:26.631492 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:26.631958 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:26.772208 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:26.780689 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0c477de6-6965-4d7d-8af8-639ac30a0b68 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.161777 Jul 21 21:03:26.781280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 491/980] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:26 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:27.798126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:27.798841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:27.806519 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:27.807058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:27.807963 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:27.808512 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:27.946818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:27.954784 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-154e5a09-9b9a-42b4-b222-0b6cfa54b10f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.160472 Jul 21 21:03:27.955567 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 490/981] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:27 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:28.971977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:28.972705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:28.981387 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:28.981841 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:28.982627 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:28.983073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:29.122068 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:29.129446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-51f17aaa-da9f-4709-bcdf-4ab18c84b3a4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.161483 Jul 21 21:03:29.130020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 492/982] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:28 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:30.147136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:30.147766 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:30.154546 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:30.154994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:30.155855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:30.156292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:30.294059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:30.302661 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-13bb5474-643d-4a6b-91d5-bf785b0f5bea tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.159385 Jul 21 21:03:30.303151 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 491/983] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:30 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:31.320086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:31.320775 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:31.323045 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:31.323740 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:31.329518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:31.329968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:31.330731 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:31.331170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:31.466046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:31.473514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6bc1104d-fa25-49e6-81ff-6dfd83ba5e64 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.157469 Jul 21 21:03:31.474088 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 493/984] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:31 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:32.490331 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:32.490944 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:32.493831 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:32.499472 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:32.499956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:32.500730 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:32.501167 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:32.635390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:32.642874 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1c724a2e-3c2d-440b-a400-1137f53c9c0a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.156712 Jul 21 21:03:32.643433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 492/985] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:32 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:33.660049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:33.660600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:33.667310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:33.667798 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:33.668573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:33.669042 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:33.671680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=59 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:33.801135 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:33.809352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-61f6e087-9f0c-44a3-bca5-e26334c634eb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.153149 Jul 21 21:03:33.809932 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 494/986] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:33 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:34.826060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:34.826674 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:34.833231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:34.833682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:34.834453 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:34.834891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:34.984860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:34.992502 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4b953220-3f23-4034-b23e-f4915054bf2c tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.170325 Jul 21 21:03:34.993059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 493/987] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:34 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:36.010689 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:36.011244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:36.017416 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:36.017863 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:36.018618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:36.019049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:36.145201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:36.152515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-23ef7b21-651b-45b6-9ccf-7217082c3c37 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.145911 Jul 21 21:03:36.153094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 495/988] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:36 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:37.169794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:37.170399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:37.176794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:37.177239 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:37.177992 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:37.178416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:37.522714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:37.530516 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-de41aae2-506a-4e71-af3d-0c0f126051b9 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.364605 Jul 21 21:03:37.531087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 494/989] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:37 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:38.154927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-f06e58b0-2907-4015-bce0-d0c3937e3f30 req-02daf864-96aa-4c34-bba1-63d8ad1ccd53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974db758-4954-4768-b496-7733bc3c0f3b", "tag": "5538cf4c-9233-42e2-88c0-e8e5d4986ab9"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:38.166054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-f06e58b0-2907-4015-bce0-d0c3937e3f30 req-02daf864-96aa-4c34-bba1-63d8ad1ccd53 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:38.166582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-f06e58b0-2907-4015-bce0-d0c3937e3f30 req-02daf864-96aa-4c34-bba1-63d8ad1ccd53 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:38.183595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-f06e58b0-2907-4015-bce0-d0c3937e3f30 req-02daf864-96aa-4c34-bba1-63d8ad1ccd53 service nova] Creating event network-changed:5538cf4c-9233-42e2-88c0-e8e5d4986ab9 for instance 974db758-4954-4768-b496-7733bc3c0f3b on hv-cinder-85068 Jul 21 21:03:38.189915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-f06e58b0-2907-4015-bce0-d0c3937e3f30 req-02daf864-96aa-4c34-bba1-63d8ad1ccd53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038886 Jul 21 21:03:38.190705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 496/990] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:03:38.548117 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:38.548781 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:38.555945 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:38.556398 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:38.557365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:38.557815 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:38.739007 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:38.746865 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7b8db944-bb94-4102-bfd8-bebe8dbc6f86 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.202765 Jul 21 21:03:38.747426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 495/991] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:38 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:39.764174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:39.764944 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:39.771077 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:39.771520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:39.772299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:39.772736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:39.905751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:39.913087 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-48dc264e-6594-4afe-a925-2bfea9eb46a3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.153724 Jul 21 21:03:39.913655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 497/992] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:39 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:40.930391 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:40.931004 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:40.937548 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:40.937996 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:40.938959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:40.939398 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:41.071259 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:41.079451 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7ffadef4-3b5c-417a-a5f2-f16b73a66804 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.153105 Jul 21 21:03:41.080041 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 496/993] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:40 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:42.097073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:42.097691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:42.105090 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:42.105542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:42.106309 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:42.106747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:42.236756 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:42.245294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5e6fa0c2-b925-4127-82f5-1370f261b1d5 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.152987 Jul 21 21:03:42.245885 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 498/994] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:42 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:43.262419 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:43.263031 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:43.269690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:43.270129 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:43.270881 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:43.271310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:43.651698 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:43.659059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-18536756-ef81-4b2a-a371-e1348e19a473 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.400489 Jul 21 21:03:43.659625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 497/995] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:43 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:44.610230 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1520565691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1053486654", "security_groups": [{"name": "tempest-secgroup-smoke-1588311094"}], "block_device_mapping_v2": [{"uuid": "8904fb3a-6c6c-41cf-98a6-0121440d6864", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4b6565cd-3bec-4ff7-8320-fd7b78910885"}]}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:44.675929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:44.676425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:44.690030 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:44.690486 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:44.691264 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:44.691706 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:44.746889 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] validate_networks() for [('4b6565cd-3bec-4ff7-8320-fd7b78910885', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:03:44.830277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:44.837780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dc105e18-618d-4149-ab07-2c842bdf3039 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.165982 Jul 21 21:03:44.838349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 498/996] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:44 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:03:44.847665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-94ac4f6c-7baa-45d0-83b5-f2cc702c1797 req-502e60ee-01e9-4504-bc58-fdaf94f44b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974db758-4954-4768-b496-7733bc3c0f3b", "name": "network-vif-plugged", "status": "completed", "tag": "5538cf4c-9233-42e2-88c0-e8e5d4986ab9"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:44.855960 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-94ac4f6c-7baa-45d0-83b5-f2cc702c1797 req-502e60ee-01e9-4504-bc58-fdaf94f44b47 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:44.856405 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-94ac4f6c-7baa-45d0-83b5-f2cc702c1797 req-502e60ee-01e9-4504-bc58-fdaf94f44b47 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:44.868390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-94ac4f6c-7baa-45d0-83b5-f2cc702c1797 req-502e60ee-01e9-4504-bc58-fdaf94f44b47 service nova] Creating event network-vif-plugged:5538cf4c-9233-42e2-88c0-e8e5d4986ab9 for instance 974db758-4954-4768-b496-7733bc3c0f3b on hv-cinder-85068 Jul 21 21:03:44.873573 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-94ac4f6c-7baa-45d0-83b5-f2cc702c1797 req-502e60ee-01e9-4504-bc58-fdaf94f44b47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029328 Jul 21 21:03:44.874178 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 499/997] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:03:45.139182 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:03:45.139610 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:03:45.140143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:03:45.140555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:03:45.140973 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:03:45.149891 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:45.150341 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:45.151140 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:45.151580 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:45.168523 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:03:45.172446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Getting quotas for user 2b3617b8bcac4227b1295e294eec664a and project f2d1bc3b35054c44bbe955a9eddc3052. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:03:45.230325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:03:45.232400 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8904fb3a-6c6c-41cf-98a6-0121440d6864',volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:03:45.361457 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fb9b8d7c-0ccc-41e4-b7e7-76ef26648fe8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.755163 Jul 21 21:03:45.362109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 499/998] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:03:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:03:45.372965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-29b131f6-78d3-4410-ba9b-f35f686f6849 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:45.373664 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-29b131f6-78d3-4410-ba9b-f35f686f6849 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:45.427576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-29b131f6-78d3-4410-ba9b-f35f686f6849 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:45.434357 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-29b131f6-78d3-4410-ba9b-f35f686f6849 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1095 microversion: 2.1 time: 0.065539 Jul 21 21:03:45.437478 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 500/999] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:45 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:45.855590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:45.856723 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:45.864219 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:45.864673 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:45.865454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:45.865986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:45.996597 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:46.004012 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b08bd6df-7484-440b-bae1-d1377606ac93 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.153736 Jul 21 21:03:46.004589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 500/1000] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:45 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:46.452116 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:46.452727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:46.460093 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:46.460549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:46.461537 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:46.461978 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:46.523573 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:46.531352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ea67136d-462f-417d-81f0-c3f5bcbef1e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1137 microversion: 2.1 time: 0.083308 Jul 21 21:03:46.531947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 501/1001] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:46 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:47.021222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:47.021832 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:47.029174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:47.029629 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:47.030427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:47.030934 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:47.169051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:47.176551 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d57e2b95-1985-4363-83d2-9f8b3289b933 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1359 microversion: 2.1 time: 0.159186 Jul 21 21:03:47.177123 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 501/1002] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:47 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:47.549175 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:47.549786 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:47.557040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:47.557482 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:47.558250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:47.558686 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:47.624828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:47.635374 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9a82330b-98f3-46c8-b845-36f1959b9bcd tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1201 microversion: 2.1 time: 0.090005 Jul 21 21:03:47.638461 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 502/1003] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:47 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:48.193783 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:48.194386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:48.201659 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.202119 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.202896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.203338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.347612 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:48.355555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-37f29e31-7c8d-4af8-b2ae-ec963f13fb9e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1549 microversion: 2.1 time: 0.165740 Jul 21 21:03:48.356771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 502/1004] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:48 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:48.374870 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:48.375857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:48.382660 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.383519 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.384969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.385796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.631887 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:48.640296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a20cd250-5a48-4bd9-ad81-a1aba5202fff tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1549 microversion: 2.1 time: 0.270352 Jul 21 21:03:48.640988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 503/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:48 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1549 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:48.657070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:48.657688 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:48.661796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:48.663859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.664314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.665670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.666095 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.666682 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:48.667455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Searching by: {'deleted': False, 'project_id': '6a26de2015bb4626ba4093aac7a3d085'} {{(pid=124646) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 21:03:48.674333 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.674779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.675607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.676091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.771970 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.multi_cell_list [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124646) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 21:03:48.813310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:48.822771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c0ba871c-21d3-4e7f-95d8-e91c0c9e5d95 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.169484 Jul 21 21:03:48.823373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 503/1006] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:48 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:03:48.872849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-19ba82db-8f3c-48df-92ea-db37b6ac0fbd tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215892 Jul 21 21:03:48.873653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 504/1007] 10.222.0.60 () {58 vars in 1124 bytes} [Thu Jul 21 21:03:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:03:48.884007 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:48.884624 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:48.891259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.891727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:48.892506 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:48.892941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:49.035036 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:49.043969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1cbc2fba-00d5-43ad-87bf-f796b6241aaa tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1549 microversion: 2.1 time: 0.164079 Jul 21 21:03:49.044559 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 504/1008] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:48 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:49.159655 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-89addd54-4a59-49bc-9ac6-8cb4cd1d4f8d req-8ae30f66-818c-4d34-be57-7850dccf8b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ea1535-d7da-47de-b2e3-dec03f1b4eea", "tag": "ef105c38-7ca3-4dca-bf85-93202680ca37"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:49.173388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-89addd54-4a59-49bc-9ac6-8cb4cd1d4f8d req-8ae30f66-818c-4d34-be57-7850dccf8b44 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:49.173841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-89addd54-4a59-49bc-9ac6-8cb4cd1d4f8d req-8ae30f66-818c-4d34-be57-7850dccf8b44 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:49.187872 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-89addd54-4a59-49bc-9ac6-8cb4cd1d4f8d req-8ae30f66-818c-4d34-be57-7850dccf8b44 service nova] Creating event network-changed:ef105c38-7ca3-4dca-bf85-93202680ca37 for instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea on hv-cinder-85068 Jul 21 21:03:49.216691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-89addd54-4a59-49bc-9ac6-8cb4cd1d4f8d req-8ae30f66-818c-4d34-be57-7850dccf8b44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060632 Jul 21 21:03:49.217317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 505/1009] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:03:49.839490 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:49.840121 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:49.846698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:49.847156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:49.847959 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:49.848404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:49.980316 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:49.987779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1137079e-c93c-444b-a4c0-7b9e94de8731 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.152444 Jul 21 21:03:49.988359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 505/1010] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:49 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:50.613822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2e4528df-2055-4604-962a-3ab93e8f7378 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f6d4b35-05e6-48a9-95e5-520fb61ddff3"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:03:50.614964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2e4528df-2055-4604-962a-3ab93e8f7378 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:50.621847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e4528df-2055-4604-962a-3ab93e8f7378 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:50.622286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e4528df-2055-4604-962a-3ab93e8f7378 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:50.623036 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e4528df-2055-4604-962a-3ab93e8f7378 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:50.623463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2e4528df-2055-4604-962a-3ab93e8f7378 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:50.639674 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=100 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:51.006389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:51.007245 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:51.014691 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:51.015472 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:51.016376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:51.016887 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:51.036361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2e4528df-2055-4604-962a-3ab93e8f7378 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425503 Jul 21 21:03:51.036800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 506/1011] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:03:50 2022] POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:03:51.176177 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:51.184515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fce5cba3-3697-4c77-a143-e7e84665e35f tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.182519 Jul 21 21:03:51.185087 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 506/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:51 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:03:52.202326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:52.203016 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:52.210230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:52.210680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:52.211977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:52.212385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:52.342048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:52.349393 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-80545d41-e64a-46e4-8743-de56170646d8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.151847 Jul 21 21:03:52.349953 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 507/1013] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:52 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:53.366843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:53.367459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:53.374806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:53.375254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:53.376049 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:53.376489 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:53.508376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:53.516591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c4a15d3e-3d25-4b09-b936-07542bb83fb5 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.153855 Jul 21 21:03:53.517164 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 507/1014] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:53 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:54.534310 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:54.534843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:54.542286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:54.542727 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:54.543494 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:54.543959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:54.684794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:54.692821 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-14ef55b7-8f16-48c5-a968-d9352edba71a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.162621 Jul 21 21:03:54.693403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 508/1015] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:54 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:55.710310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:55.710928 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:55.713746 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:55.714423 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:55.715214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:55.721378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:55.721833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:55.722595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:55.723032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:55.852737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:55.860323 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ddaa5531-6dfd-4e1e-8ff5-7a213ba38c60 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.153930 Jul 21 21:03:55.860903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 508/1016] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:55 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:56.877928 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:56.878539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:56.881124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:56.881801 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=42 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:56.887687 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:56.888165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:56.888933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:56.889405 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:57.025399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:57.032847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-81bd14c9-e6bf-4f59-83e5-03539b20ac8b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.158723 Jul 21 21:03:57.033410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 509/1017] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:56 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:58.049790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:58.050429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:58.057525 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:58.057971 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:58.058728 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:58.059163 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:58.447461 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:58.455074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-403072dd-2375-4ce8-a9ab-af473f69a193 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.409148 Jul 21 21:03:58.455662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 509/1018] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:58 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:59.472279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:59.472890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:59.475223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:03:59.484110 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:59.484563 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:59.485697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:59.485818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:59.632425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:59.640577 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-be2ab033-d4bd-4c0a-9d74-07039c8b5c5e tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.172134 Jul 21 21:03:59.641146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 510/1019] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:59 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:03:59.653679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:03:59.654300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:03:59.660796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:59.661253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:59.662034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:03:59.662499 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:03:59.793566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:03:59.801558 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-704fc567-3cca-442a-a495-24b00f0fca12 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1595 microversion: 2.1 time: 0.152385 Jul 21 21:03:59.802132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 510/1020] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:03:59 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:00.657818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:00.658540 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:00.665769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:00.666264 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:00.666990 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:00.667421 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:00.817577 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:00.826931 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-66af6104-759d-49c2-88b2-47fea75354e0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.172980 Jul 21 21:04:00.827511 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 511/1021] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:00 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:00.964768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-66c6c8dd-5cb4-4e04-92bc-77cb7ea47642 req-26e4cf6a-be8e-4fca-a0cd-c02d8b07cb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ea1535-d7da-47de-b2e3-dec03f1b4eea", "name": "network-vif-plugged", "status": "completed", "tag": "ef105c38-7ca3-4dca-bf85-93202680ca37"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:00.972824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-66c6c8dd-5cb4-4e04-92bc-77cb7ea47642 req-26e4cf6a-be8e-4fca-a0cd-c02d8b07cb41 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:00.973269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-66c6c8dd-5cb4-4e04-92bc-77cb7ea47642 req-26e4cf6a-be8e-4fca-a0cd-c02d8b07cb41 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:00.984478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-66c6c8dd-5cb4-4e04-92bc-77cb7ea47642 req-26e4cf6a-be8e-4fca-a0cd-c02d8b07cb41 service nova] Creating event network-vif-plugged:ef105c38-7ca3-4dca-bf85-93202680ca37 for instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea on hv-cinder-85068 Jul 21 21:04:00.989678 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-66c6c8dd-5cb4-4e04-92bc-77cb7ea47642 req-26e4cf6a-be8e-4fca-a0cd-c02d8b07cb41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157870 Jul 21 21:04:00.990466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 511/1022] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:01.486177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-78ef26cd-101c-401c-ad05-5d8dfbdfd94c req-4c480d90-5b15-4dfe-a4db-dc7373da4986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974db758-4954-4768-b496-7733bc3c0f3b", "tag": "5538cf4c-9233-42e2-88c0-e8e5d4986ab9"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:01.496916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-78ef26cd-101c-401c-ad05-5d8dfbdfd94c req-4c480d90-5b15-4dfe-a4db-dc7373da4986 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:01.497659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-78ef26cd-101c-401c-ad05-5d8dfbdfd94c req-4c480d90-5b15-4dfe-a4db-dc7373da4986 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:01.510574 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-78ef26cd-101c-401c-ad05-5d8dfbdfd94c req-4c480d90-5b15-4dfe-a4db-dc7373da4986 service nova] Creating event network-changed:5538cf4c-9233-42e2-88c0-e8e5d4986ab9 for instance 974db758-4954-4768-b496-7733bc3c0f3b on hv-cinder-85068 Jul 21 21:04:01.515594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-78ef26cd-101c-401c-ad05-5d8dfbdfd94c req-4c480d90-5b15-4dfe-a4db-dc7373da4986 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035068 Jul 21 21:04:01.516227 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 512/1023] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:01.844696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:01.845869 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:01.853172 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:01.854719 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:01.855729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:01.856547 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:02.054259 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:02.058013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=100 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:04:02.064572 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-51998b0a-70ef-429e-a7cf-4a9ab8cb3ff1 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.224053 Jul 21 21:04:02.081933 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 512/1024] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:01 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:02.506345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1364094149"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:02.507096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:02.514228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:02.514761 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:02.515668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:02.516196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:02.650467 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.network.security_group_api [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Adding security group 30209766-afea-4350-9623-3bc5c35de3b8 to port 5538cf4c-9233-42e2-88c0-e8e5d4986ab9 Jul 21 21:04:03.082992 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:03.083738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:03.090830 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:03.091348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:03.092228 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:03.092749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:03.182886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f8ab2e6d-9d01-4fd3-a3d2-24cde435f35f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/action" status: 202 len: 0 microversion: 2.1 time: 0.681452 Jul 21 21:04:03.183358 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 513/1025] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 21:04:02 2022] POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:04:03.192276 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:03.193342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:03.203920 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:03.205210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:03.206372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:03.207492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:03.287275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:03.296896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c2d42318-42c5-43ed-8f69-8dabd0f9acff tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1267 microversion: 2.1 time: 0.218035 Jul 21 21:04:03.305898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 513/1026] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:03 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:04:03.424378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-7ee8af4b-f6e5-4a35-9369-71bdfcb32b18 req-bc8fd0bb-1c17-4099-8d69-7de405bc1e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974db758-4954-4768-b496-7733bc3c0f3b", "tag": "5538cf4c-9233-42e2-88c0-e8e5d4986ab9"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:03.434306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-7ee8af4b-f6e5-4a35-9369-71bdfcb32b18 req-bc8fd0bb-1c17-4099-8d69-7de405bc1e32 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:03.434821 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-7ee8af4b-f6e5-4a35-9369-71bdfcb32b18 req-bc8fd0bb-1c17-4099-8d69-7de405bc1e32 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:03.445493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:03.447779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-7ee8af4b-f6e5-4a35-9369-71bdfcb32b18 req-bc8fd0bb-1c17-4099-8d69-7de405bc1e32 service nova] Creating event network-changed:5538cf4c-9233-42e2-88c0-e8e5d4986ab9 for instance 974db758-4954-4768-b496-7733bc3c0f3b on hv-cinder-85068 Jul 21 21:04:03.453397 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-7ee8af4b-f6e5-4a35-9369-71bdfcb32b18 req-bc8fd0bb-1c17-4099-8d69-7de405bc1e32 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145348 Jul 21 21:04:03.454203 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 514/1027] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:03.454739 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-61f0d754-01d0-4afb-ab6d-58a3d02cb314 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1642 microversion: 2.1 time: 0.266361 Jul 21 21:04:03.455414 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 514/1028] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:03 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1642 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:04.315367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:04.316089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:04.323080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:04.323530 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:04.324356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:04.324805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:04.458587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:04.466972 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ae4615cb-9ffa-484a-acbb-ce07a0260e1a tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1454 microversion: 2.1 time: 0.156350 Jul 21 21:04:04.467566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 515/1029] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:04 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:04.483594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:04.484230 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:04.490812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:04.491260 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:04.492317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:04.493429 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:04.930635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:04.938143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1e9b3892-4e4b-4e09-9dfd-98a61c472c1b tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1454 microversion: 2.1 time: 0.458335 Jul 21 21:04:04.938712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 515/1030] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:04 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1454 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:06.872393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-c74c6014-5208-4bf0-959d-66b2d8338cf4 req-afd16836-2976-4a45-99b9-848175ce331a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ea1535-d7da-47de-b2e3-dec03f1b4eea", "tag": "ef105c38-7ca3-4dca-bf85-93202680ca37"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:06.880520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-c74c6014-5208-4bf0-959d-66b2d8338cf4 req-afd16836-2976-4a45-99b9-848175ce331a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:06.880961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-c74c6014-5208-4bf0-959d-66b2d8338cf4 req-afd16836-2976-4a45-99b9-848175ce331a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:06.891752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-c74c6014-5208-4bf0-959d-66b2d8338cf4 req-afd16836-2976-4a45-99b9-848175ce331a service nova] Creating event network-changed:ef105c38-7ca3-4dca-bf85-93202680ca37 for instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea on hv-cinder-85068 Jul 21 21:04:06.896683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-c74c6014-5208-4bf0-959d-66b2d8338cf4 req-afd16836-2976-4a45-99b9-848175ce331a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028677 Jul 21 21:04:06.897253 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 516/1031] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:31.763332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e5087897-961f-4c38-bd22-17c9d1d583fe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:31.763987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e5087897-961f-4c38-bd22-17c9d1d583fe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:31.765968 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=13 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:04:31.766607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:04:31.773026 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5087897-961f-4c38-bd22-17c9d1d583fe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:31.773468 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5087897-961f-4c38-bd22-17c9d1d583fe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:31.774788 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5087897-961f-4c38-bd22-17c9d1d583fe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:31.775268 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e5087897-961f-4c38-bd22-17c9d1d583fe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:31.801223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e5087897-961f-4c38-bd22-17c9d1d583fe tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/ips" status: 200 len: 145 microversion: 2.1 time: 0.042445 Jul 21 21:04:31.801792 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 516/1032] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 21:04:31 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:33.116631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=17 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:04:33.118526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=17 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:04:33.122502 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7d79aae2-0d54-47df-9c58-50cbd27fa22b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8795027d-3f8b-4daf-86bb-a57082442259"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:33.123672 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7d79aae2-0d54-47df-9c58-50cbd27fa22b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:33.130637 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d79aae2-0d54-47df-9c58-50cbd27fa22b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:33.131089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d79aae2-0d54-47df-9c58-50cbd27fa22b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:33.131881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d79aae2-0d54-47df-9c58-50cbd27fa22b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:33.132325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7d79aae2-0d54-47df-9c58-50cbd27fa22b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:33.403887 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7d79aae2-0d54-47df-9c58-50cbd27fa22b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288650 Jul 21 21:04:33.404515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 517/1033] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:04:33 2022] POST /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:39.355654 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:04:39.356467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 21:04:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:04:40.888253 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-80bb3e69-9d6b-40b1-b4b1-736c3b700278 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:40.889237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-80bb3e69-9d6b-40b1-b4b1-736c3b700278 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:40.895617 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80bb3e69-9d6b-40b1-b4b1-736c3b700278 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:40.896100 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80bb3e69-9d6b-40b1-b4b1-736c3b700278 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:40.896859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80bb3e69-9d6b-40b1-b4b1-736c3b700278 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:40.897292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-80bb3e69-9d6b-40b1-b4b1-736c3b700278 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:40.928458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-80bb3e69-9d6b-40b1-b4b1-736c3b700278 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Jul 21 21:04:40.929022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 517/1034] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:04:40 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:40.939827 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2a173b11-e967-4b64-8761-70c34fed16e0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:40.940413 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2a173b11-e967-4b64-8761-70c34fed16e0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:40.947529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a173b11-e967-4b64-8761-70c34fed16e0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:40.948016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a173b11-e967-4b64-8761-70c34fed16e0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:40.948786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a173b11-e967-4b64-8761-70c34fed16e0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:40.949222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2a173b11-e967-4b64-8761-70c34fed16e0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:40.981506 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2a173b11-e967-4b64-8761-70c34fed16e0 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/8795027d-3f8b-4daf-86bb-a57082442259" status: 200 len: 194 microversion: 2.1 time: 0.045966 Jul 21 21:04:40.982086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 518/1035] 10.222.0.60 () {58 vars in 1412 bytes} [Thu Jul 21 21:04:40 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/8795027d-3f8b-4daf-86bb-a57082442259 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:42.134986 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0cfa2b84-d781-47af-a960-f70dc19fc40a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:42.135929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0cfa2b84-d781-47af-a960-f70dc19fc40a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:42.142671 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b84-d781-47af-a960-f70dc19fc40a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.143109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b84-d781-47af-a960-f70dc19fc40a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.143899 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b84-d781-47af-a960-f70dc19fc40a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.144331 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0cfa2b84-d781-47af-a960-f70dc19fc40a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.172818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0cfa2b84-d781-47af-a960-f70dc19fc40a tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042110 Jul 21 21:04:42.173364 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 518/1036] 10.222.0.60 () {60 vars in 1342 bytes} [Thu Jul 21 21:04:42 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:42.231728 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:42.232343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:42.240431 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.240953 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.242906 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.244103 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.271984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Going to try to terminate instance {{(pid=124647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:04:42.303112 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5d51be34-02cd-443d-a2af-912166374dc6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2814e3c9-aec4-43aa-b70b-11ce7773deb1"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:42.304238 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5d51be34-02cd-443d-a2af-912166374dc6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:42.312468 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5d51be34-02cd-443d-a2af-912166374dc6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.313050 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5d51be34-02cd-443d-a2af-912166374dc6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.313864 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5d51be34-02cd-443d-a2af-912166374dc6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.314565 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5d51be34-02cd-443d-a2af-912166374dc6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.349246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-101ff135-5c94-442e-99da-e023fa77ede4 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 204 len: 0 microversion: 2.20 time: 0.121539 Jul 21 21:04:42.349833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 519/1037] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Jul 21 21:04:42 2022] DELETE /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 21:04:42.359233 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:42.359972 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:42.365920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.366381 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.368040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:42.368732 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:42.498135 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:42.506071 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:42.507563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:42.509356 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9bfd9264-aa72-458d-85cc-9e8b51f869b5 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.154858 Jul 21 21:04:42.509912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 520/1038] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:04:42 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:04:43.528326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:43.528957 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:43.535449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:43.535929 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:43.536683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:43.537115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:43.667825 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:43.675706 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:43.677199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:43.678354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2e3af488-9afe-4d5e-b499-0421b9215ebd tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.153931 Jul 21 21:04:43.678920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 521/1039] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:04:43 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:04:43.844781 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5d51be34-02cd-443d-a2af-912166374dc6 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "POST /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.546141 Jul 21 21:04:43.845386 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 519/1040] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:04:42 2022] POST /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments => generated 194 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:04:44.697996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:44.699787 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:44.708331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:44.708786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:44.709613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:44.710054 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:44.840116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:44.848188 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:44.849688 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:44.850849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c2b64599-acec-49b9-8ec6-4f259e310855 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1723 microversion: 2.20 time: 0.158094 Jul 21 21:04:44.851474 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 522/1041] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:04:44 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:04:45.549284 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-e54da59b-b2b0-45d1-a6ce-209a14e30312 req-e0230acf-1a14-4429-b73d-92adc47fc7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4fa343-16d7-4f75-a3e3-3abef4456ed6", "name": "network-vif-deleted", "tag": "4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:45.561506 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-e54da59b-b2b0-45d1-a6ce-209a14e30312 req-e0230acf-1a14-4429-b73d-92adc47fc7f8 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:45.562044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-e54da59b-b2b0-45d1-a6ce-209a14e30312 req-e0230acf-1a14-4429-b73d-92adc47fc7f8 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:45.574153 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-e54da59b-b2b0-45d1-a6ce-209a14e30312 req-e0230acf-1a14-4429-b73d-92adc47fc7f8 service nova] Creating event network-vif-deleted:4c568ff9-9eab-4cf6-8f3c-7a786ef7e8a8 for instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 on hv-cinder-85068 Jul 21 21:04:45.579255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-e54da59b-b2b0-45d1-a6ce-209a14e30312 req-e0230acf-1a14-4429-b73d-92adc47fc7f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035616 Jul 21 21:04:45.579935 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 520/1042] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:45.869870 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:45.870424 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:45.877132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:45.877580 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:45.878357 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:45.878801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:45.911199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:45.911682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:45.912169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lazy-loading 'fault' on Instance uuid fb4fa343-16d7-4f75-a3e3-3abef4456ed6 {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:04:45.953902 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:45.963075 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:45.964973 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a0d900f08d54098870ebbfa281e2a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c312164b3fdd40719fcdd94ed6bfd187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:45.966319 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-845881b5-da98-4bfd-9ce5-7f26e1d9accc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 200 len: 1372 microversion: 2.20 time: 0.100641 Jul 21 21:04:45.967139 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 523/1043] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:04:45 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:04:46.986218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:46.986827 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:46.993640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:46.994086 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:46.994860 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:46.995296 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:47.009111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] HTTP exception thrown: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Request method failure captured: Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 HTTP/1.1 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byb2VznJGGWOMZ3iy2W42fJKwACNx7Jknpc9V79qs6yqzGOanqSBdRwj--gaLUm-f_rD0C1hOTadmIeOIMStcsCHAVww2fxltqkkvAkxEwUsBjBU3vITJw0IyVq_5TNJnUgoDvWZoTOUrpzRl4K073dGgYVdLzw-F5IckwMVh07HV4 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:04:47.010712 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 3a0d900f08d54098870ebbfa281e2a65 Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:47.012465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'fb4fa343-16d7-4f75-a3e3-3abef4456ed6'} Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:04:47.013463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:47.014952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:47.016332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Returning 404 to user: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:04:47.016332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-efa23bca-db5f-48df-9b3b-c5ce5ca6b9a3 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 404 len: 111 microversion: 2.20 time: 0.030674 Jul 21 21:04:47.016332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 521/1044] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:04:46 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:04:47.020881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-01c45937-b18e-46e3-821b-4adc4fd1c0cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '.version_select at 0x7f3540b021f0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:47.045126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-01c45937-b18e-46e3-821b-4adc4fd1c0cc tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614896864" status: 204 len: 0 microversion: 2.20 time: 0.027783 Jul 21 21:04:47.045823 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 524/1045] 10.222.0.60 () {60 vars in 1261 bytes} [Thu Jul 21 21:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614896864 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 21:04:48.787998 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:48.788536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:48.795261 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:48.795736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:48.796509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:48.796946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:48.810426 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] HTTP exception thrown: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Request method failure captured: Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 HTTP/1.1 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byb2VznJGGWOMZ3iy2W42fJKwACNx7Jknpc9V79qs6yqzGOanqSBdRwj--gaLUm-f_rD0C1hOTadmIeOIMStcsCHAVww2fxltqkkvAkxEwUsBjBU3vITJw0IyVq_5TNJnUgoDvWZoTOUrpzRl4K073dGgYVdLzw-F5IckwMVh07HV4 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:04:48.812103 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 3a0d900f08d54098870ebbfa281e2a65 Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.813843 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'fb4fa343-16d7-4f75-a3e3-3abef4456ed6'} Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:04:48.814697 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.816206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.817942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Returning 404 to user: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:04:48.817942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-868dc69e-b9cd-422f-827a-526d0389d108 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 404 len: 111 microversion: 2.20 time: 0.029458 Jul 21 21:04:48.817942 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 522/1046] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Jul 21 21:04:48 2022] DELETE /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:04:48.822736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:48.823359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: fb4fa343-16d7-4f75-a3e3-3abef4456ed6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:48.829892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:48.830335 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:48.831093 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:48.831553 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:48.844933 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] HTTP exception thrown: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Request method failure captured: Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 HTTP/1.1 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2byb2VznJGGWOMZ3iy2W42fJKwACNx7Jknpc9V79qs6yqzGOanqSBdRwj--gaLUm-f_rD0C1hOTadmIeOIMStcsCHAVww2fxltqkkvAkxEwUsBjBU3vITJw0IyVq_5TNJnUgoDvWZoTOUrpzRl4K073dGgYVdLzw-F5IckwMVh07HV4 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:04:48.846552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 3a0d900f08d54098870ebbfa281e2a65 Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.848235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'fb4fa343-16d7-4f75-a3e3-3abef4456ed6'} Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:04:48.849149 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. Jul 21 21:04:48.850638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:48.851926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Returning 404 to user: Instance fb4fa343-16d7-4f75-a3e3-3abef4456ed6 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:04:48.851926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-de2d319a-f348-4f67-a0ea-ba500547c41b tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6" status: 404 len: 111 microversion: 2.20 time: 0.030029 Jul 21 21:04:48.851926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 525/1047] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:04:48 2022] GET /compute/v2.1/servers/fb4fa343-16d7-4f75-a3e3-3abef4456ed6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:04:49.990428 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:49.990929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:49.997689 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:49.998137 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:49.998896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:49.999329 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:50.012814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] HTTP exception thrown: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Request method failure captured: Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 HTTP/1.1 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2byb2VznJGGWOMZ3iy2W42fJKwACNx7Jknpc9V79qs6yqzGOanqSBdRwj--gaLUm-f_rD0C1hOTadmIeOIMStcsCHAVww2fxltqkkvAkxEwUsBjBU3vITJw0IyVq_5TNJnUgoDvWZoTOUrpzRl4K073dGgYVdLzw-F5IckwMVh07HV4 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:04:50.014335 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 3a0d900f08d54098870ebbfa281e2a65 Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.016032 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'b6b1f12b-2ec1-4e9b-ac1b-61385f597069'} Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:04:50.016988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.018483 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.020047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Returning 404 to user: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:04:50.020047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c53de646-63b0-4297-8ff6-3a2386cd4aaa tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 404 len: 111 microversion: 2.20 time: 0.029121 Jul 21 21:04:50.020047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 523/1048] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Jul 21 21:04:49 2022] DELETE /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:04:50.024757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:50.025382 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] [instance: b6b1f12b-2ec1-4e9b-ac1b-61385f597069] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:50.031843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:50.032360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:50.033153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:50.033575 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:50.049963 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] HTTP exception thrown: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Request method failure captured: Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 HTTP/1.1 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2byb2VznJGGWOMZ3iy2W42fJKwACNx7Jknpc9V79qs6yqzGOanqSBdRwj--gaLUm-f_rD0C1hOTadmIeOIMStcsCHAVww2fxltqkkvAkxEwUsBjBU3vITJw0IyVq_5TNJnUgoDvWZoTOUrpzRl4K073dGgYVdLzw-F5IckwMVh07HV4 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:04:50.051485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c312164b3fdd40719fcdd94ed6bfd187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: c312164b3fdd40719fcdd94ed6bfd187 Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-283935891 Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 3a0d900f08d54098870ebbfa281e2a65 Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-283935891-project Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.053191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'b6b1f12b-2ec1-4e9b-ac1b-61385f597069'} Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:04:50.054073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. Jul 21 21:04:50.055430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:04:50.056566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] Returning 404 to user: Instance b6b1f12b-2ec1-4e9b-ac1b-61385f597069 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:04:50.056566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a1d5bec6-7c54-4d1b-a4cc-b98b11a76b18 tempest-AttachVolumeShelveTestJSON-283935891 tempest-AttachVolumeShelveTestJSON-283935891-project] 10.222.0.60 "GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069" status: 404 len: 111 microversion: 2.20 time: 0.032651 Jul 21 21:04:50.056566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 526/1049] 10.222.0.60 () {60 vars in 1276 bytes} [Thu Jul 21 21:04:50 2022] GET /compute/v2.1/servers/b6b1f12b-2ec1-4e9b-ac1b-61385f597069 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:04:52.410796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fc9703d2-a68b-473f-9f1e-080fe94ea59b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:52.411818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fc9703d2-a68b-473f-9f1e-080fe94ea59b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:52.419014 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc9703d2-a68b-473f-9f1e-080fe94ea59b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:52.419665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc9703d2-a68b-473f-9f1e-080fe94ea59b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:52.420680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc9703d2-a68b-473f-9f1e-080fe94ea59b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:52.421114 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fc9703d2-a68b-473f-9f1e-080fe94ea59b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:52.452991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fc9703d2-a68b-473f-9f1e-080fe94ea59b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046076 Jul 21 21:04:52.453583 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 524/1050] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:04:52 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:52.771315 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-abf7c50e-d92c-4cb8-8c83-ea13942c6a19 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:52.772901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-abf7c50e-d92c-4cb8-8c83-ea13942c6a19 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:52.779932 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-abf7c50e-d92c-4cb8-8c83-ea13942c6a19 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:52.780420 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-abf7c50e-d92c-4cb8-8c83-ea13942c6a19 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:52.781201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-abf7c50e-d92c-4cb8-8c83-ea13942c6a19 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:52.781649 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-abf7c50e-d92c-4cb8-8c83-ea13942c6a19 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:52.814987 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-abf7c50e-d92c-4cb8-8c83-ea13942c6a19 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/8795027d-3f8b-4daf-86bb-a57082442259" status: 200 len: 194 microversion: 2.1 time: 0.053995 Jul 21 21:04:52.815577 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 527/1051] 10.222.0.60 () {58 vars in 1412 bytes} [Thu Jul 21 21:04:52 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/8795027d-3f8b-4daf-86bb-a57082442259 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:52.825256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:52.825748 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:52.831983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:52.832541 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:52.833317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:52.833754 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:52.921951 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lazy-loading 'services' on Instance uuid 012d5bba-82b3-4bf8-b491-d700fcf78cef {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:04:53.005849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e0fbc434-4435-44b9-91fe-4e46ccdc53a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/8795027d-3f8b-4daf-86bb-a57082442259" status: 202 len: 0 microversion: 2.1 time: 0.184260 Jul 21 21:04:53.007221 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 525/1052] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:04:52 2022] DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/8795027d-3f8b-4daf-86bb-a57082442259 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:04:54.610975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2f7fff79-0b16-4fa6-bd76-b595b2f5d8c5 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Action: 'create', calling method: .version_select at 0x7f354006d0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2018483644"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:54.901480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2f7fff79-0b16-4fa6-bd76-b595b2f5d8c5 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.407660 Jul 21 21:04:54.902098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 528/1053] 10.222.0.60 () {60 vars in 1154 bytes} [Thu Jul 21 21:04:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 409 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 21 21:04:54.913585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-451e06c4-5ae3-40e5-97c2-a39b4cb36764 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f35402ffaf0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:54.964365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-451e06c4-5ae3-40e5-97c2-a39b4cb36764 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c" status: 200 len: 345 microversion: 2.1 time: 0.054871 Jul 21 21:04:54.965022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 526/1054] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:04:54 2022] GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:55.188538 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d991b272-3af9-4f4a-b90f-7db1b2e749d7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:55.189033 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d991b272-3af9-4f4a-b90f-7db1b2e749d7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:55.195263 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d991b272-3af9-4f4a-b90f-7db1b2e749d7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:55.195754 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d991b272-3af9-4f4a-b90f-7db1b2e749d7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:55.196484 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d991b272-3af9-4f4a-b90f-7db1b2e749d7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:55.196915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d991b272-3af9-4f4a-b90f-7db1b2e749d7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:55.227739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d991b272-3af9-4f4a-b90f-7db1b2e749d7 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/2814e3c9-aec4-43aa-b70b-11ce7773deb1" status: 200 len: 194 microversion: 2.1 time: 0.042325 Jul 21 21:04:55.228570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 529/1055] 10.222.0.60 () {58 vars in 1412 bytes} [Thu Jul 21 21:04:55 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/2814e3c9-aec4-43aa-b70b-11ce7773deb1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:55.238243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:55.238892 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:55.245344 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:55.245806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:55.246588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:55.247025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:55.324024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lazy-loading 'services' on Instance uuid 012d5bba-82b3-4bf8-b491-d700fcf78cef {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:04:55.394252 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-45d5a85e-1dc6-4125-9539-2b2d7a9de1de tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/2814e3c9-aec4-43aa-b70b-11ce7773deb1" status: 202 len: 0 microversion: 2.1 time: 0.159711 Jul 21 21:04:55.394837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 527/1056] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:04:55 2022] DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments/2814e3c9-aec4-43aa-b70b-11ce7773deb1 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:04:55.977644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-786757c5-f6ca-4b13-8b2d-6e9ab7697f29 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f35402bc5e0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.028686 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-786757c5-f6ca-4b13-8b2d-6e9ab7697f29 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c" status: 200 len: 346 microversion: 2.1 time: 0.055290 Jul 21 21:04:56.029697 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 530/1057] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:04:55 2022] GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:56.042396 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3553d0fc-d2e3-4da9-bdbc-3f0edaee1069 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Action: 'create', calling method: .version_select at 0x7f3544a0faf0>, body: {"snapshot": {"volume_id": "6bf7c635-9cd5-46e5-a806-cbce9187167c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1583973127"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:04:56.199481 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3553d0fc-d2e3-4da9-bdbc-3f0edaee1069 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.162466 Jul 21 21:04:56.200107 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 528/1058] 10.222.0.60 () {60 vars in 1161 bytes} [Thu Jul 21 21:04:56 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:56.210218 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ce7f1b89-29f7-4ccd-add5-2e5f2be79693 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f3540ceaca0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.242557 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ce7f1b89-29f7-4ccd-add5-2e5f2be79693 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.035953 Jul 21 21:04:56.243775 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 531/1059] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:04:56 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:56.253700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e6c2e448-33a2-4b92-a7d2-b8cbc112a8a4 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f354029f310>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.284256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e6c2e448-33a2-4b92-a7d2-b8cbc112a8a4 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034423 Jul 21 21:04:56.284830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 529/1060] 10.222.0.60 () {58 vars in 1139 bytes} [Thu Jul 21 21:04:56 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:56.295922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d67a0313-73be-49b3-8b3a-d35e6b6d8426 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f3540cea5e0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.327030 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d67a0313-73be-49b3-8b3a-d35e6b6d8426 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.034848 Jul 21 21:04:56.327593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 532/1061] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:04:56 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:56.565726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-09f49a30-7339-4bb5-be31-c3ccdda325b5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.566761 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-09f49a30-7339-4bb5-be31-c3ccdda325b5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:56.574463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09f49a30-7339-4bb5-be31-c3ccdda325b5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.574911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09f49a30-7339-4bb5-be31-c3ccdda325b5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:56.575680 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09f49a30-7339-4bb5-be31-c3ccdda325b5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.576136 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-09f49a30-7339-4bb5-be31-c3ccdda325b5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:56.608711 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-09f49a30-7339-4bb5-be31-c3ccdda325b5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048050 Jul 21 21:04:56.609275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 530/1062] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:04:56 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:04:56.725205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-04185d5f-8df5-4fb8-a33e-6a6fbebc17c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.726171 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-04185d5f-8df5-4fb8-a33e-6a6fbebc17c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:56.733268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04185d5f-8df5-4fb8-a33e-6a6fbebc17c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.733715 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04185d5f-8df5-4fb8-a33e-6a6fbebc17c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:56.735195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04185d5f-8df5-4fb8-a33e-6a6fbebc17c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.735195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-04185d5f-8df5-4fb8-a33e-6a6fbebc17c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:56.764667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-04185d5f-8df5-4fb8-a33e-6a6fbebc17c1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043292 Jul 21 21:04:56.765124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 533/1063] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:04:56 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:04:56.824059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.824558 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:56.830614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.831057 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:56.831866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.832302 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:56.859027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:04:56.939552 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a5fdf585-b402-4bc9-9e84-4ea833e000c2 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 204 len: 0 microversion: 2.1 time: 0.119036 Jul 21 21:04:56.940164 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 531/1064] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:04:56 2022] DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:04:56.949790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:56.950414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:56.956694 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.957153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:56.957934 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:56.958374 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:57.094358 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:57.102390 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a15a126c-25e5-463e-b652-348b04805763 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1673 microversion: 2.1 time: 0.157110 Jul 21 21:04:57.103078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 534/1065] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:56 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:57.339076 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5c2e3b3a-cdf1-40ea-87e4-8e89b0d21b8c tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f354029f700>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:57.369707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5c2e3b3a-cdf1-40ea-87e4-8e89b0d21b8c tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.034986 Jul 21 21:04:57.370271 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 532/1066] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:04:57 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:58.120595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:58.121379 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:58.127996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:58.128446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:58.129206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:58.129639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:58.261009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:58.268489 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-610c261b-2117-41f8-9773-5b4d12444b25 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1673 microversion: 2.1 time: 0.152600 Jul 21 21:04:58.269057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 535/1067] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:58 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:58.381462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-90afdd7e-6709-4b39-b858-b4263b92f810 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f354032caf0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:58.411286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-90afdd7e-6709-4b39-b858-b4263b92f810 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.034045 Jul 21 21:04:58.411880 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 533/1068] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:04:58 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:04:58.431961 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:04:58.432128 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Thu Jul 21 21:04:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:04:59.285646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:59.286266 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:04:59.293518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:59.293977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:59.294747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:04:59.295187 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:04:59.313632 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:04:59.424544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e0df841f-f5dc-4413-8155-6f32cbfd263c tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f354029fca0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:04:59.426297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:04:59.434080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8513e4ec-08f0-459d-a848-f48cbf10ceef tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1673 microversion: 2.1 time: 0.152291 Jul 21 21:04:59.434655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 536/1069] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:04:59 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:04:59.454127 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e0df841f-f5dc-4413-8155-6f32cbfd263c tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.034031 Jul 21 21:04:59.454687 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 534/1070] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:04:59 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:05:00.451394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:00.452033 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:00.458530 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:00.458983 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:00.459775 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:00.460216 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:00.466767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ccd9e4ab-1019-40a9-90cd-1edca0014ead tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f35401e68b0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:00.497570 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ccd9e4ab-1019-40a9-90cd-1edca0014ead tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.035043 Jul 21 21:05:00.498139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 535/1071] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:05:00 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:05:00.595804 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:00.603981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8f296aa4-331e-4737-a502-4c1aafe37bc4 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1673 microversion: 2.1 time: 0.156556 Jul 21 21:05:00.604552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 537/1072] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:00 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:01.509877 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-302ac25a-e728-4a18-b2e1-d9d886c85c8f tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f354029f790>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:01.538216 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-302ac25a-e728-4a18-b2e1-d9d886c85c8f tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.032763 Jul 21 21:05:01.538779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 536/1073] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:05:01 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:01.621151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:01.621759 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:01.628347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:01.628794 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:01.629564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:01.629978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:01.765082 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:01.772607 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-03ae47fc-613c-4f3a-8d67-2ebc20a25c62 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1673 microversion: 2.1 time: 0.155638 Jul 21 21:05:01.773222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 538/1074] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:01 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:02.551097 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9a253ef4-e589-490f-b595-5a2375e05d36 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f35402ae0d0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:02.581168 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9a253ef4-e589-490f-b595-5a2375e05d36 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 288 microversion: 2.1 time: 0.034501 Jul 21 21:05:02.581736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 537/1075] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:05:02 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:02.591880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b5110fb6-7d02-41b0-9210-ebfed0ac4c34 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f3540c96dc0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:02.648429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b5110fb6-7d02-41b0-9210-ebfed0ac4c34 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 202 len: 0 microversion: 2.1 time: 0.060382 Jul 21 21:05:02.649871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 539/1076] 10.222.0.60 () {58 vars in 1253 bytes} [Thu Jul 21 21:05:02 2022] DELETE /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:05:02.657417 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2c881773-9f13-4930-b8dc-0c0e3e463ee9 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f35449f7040>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:02.687196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2c881773-9f13-4930-b8dc-0c0e3e463ee9 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 200 len: 287 microversion: 2.1 time: 0.033607 Jul 21 21:05:02.687780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 538/1077] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:05:02 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:02.790137 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:02.790755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:02.796998 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:02.797559 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:02.798373 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:02.798819 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:02.929833 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:02.938260 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a4db6512-c174-40a5-a294-3005c10c9f2b tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1673 microversion: 2.1 time: 0.152153 Jul 21 21:05:02.938827 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 540/1078] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:02 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:03.698130 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-eb0a37c2-deb1-4c60-bc20-6cc38a4bb6b0 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f35449f7430>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:03.727391 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-eb0a37c2-deb1-4c60-bc20-6cc38a4bb6b0 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] HTTP exception thrown: Snapshot cd09d72d-55fe-4e11-85da-47cb42efcd4a could not be found. Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-eb0a37c2-deb1-4c60-bc20-6cc38a4bb6b0 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Request method failure captured: Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a HTTP/1.1 Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b92lEfAXTvgtPsl_huS1Im8SxpApmbKMgWPpA2-gj-SjWCGSmZvUisCuZbYe4xNuh0lgcH78Fq3MgL_w9zS_Y-jo8xMnVC7mH3upRXhJgvOvV_mExS0d52TWX4XgJzWoGqS6OXxrdsdJyr8NTWaxgwGKX1lROFNWsBPokyFZF8Qf_Q Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:05:03.730967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72d4aa110cf348049f72ae629879beea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 12941ff7dc2c42b18dcc5acfa79275c2 Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Snapshot cd09d72d-55fe-4e11-85da-47cb42efcd4a could not be found. Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'cd09d72d-55fe-4e11-85da-47cb42efcd4a'} Jul 21 21:05:03.732740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cd09d72d-55fe-4e11-85da-47cb42efcd4a could not be found. (HTTP 404) (Request-ID: req-d49d0121-0af3-49bc-92c0-9fd0eb950435) Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:03.733673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:05:03.734906 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cd09d72d-55fe-4e11-85da-47cb42efcd4a could not be found. Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 21:05:03.736901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cd09d72d-55fe-4e11-85da-47cb42efcd4a could not be found. Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cd09d72d-55fe-4e11-85da-47cb42efcd4a could not be found. Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-eb0a37c2-deb1-4c60-bc20-6cc38a4bb6b0 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Returning 404 to user: Snapshot cd09d72d-55fe-4e11-85da-47cb42efcd4a could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:03.738497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-eb0a37c2-deb1-4c60-bc20-6cc38a4bb6b0 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a" status: 404 len: 111 microversion: 2.1 time: 0.038524 Jul 21 21:05:03.739511 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 539/1079] 10.222.0.60 () {58 vars in 1250 bytes} [Thu Jul 21 21:05:03 2022] GET /compute/v2.1/os-snapshots/cd09d72d-55fe-4e11-85da-47cb42efcd4a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:03.742337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0a4405b7-e1a1-4282-bd87-3c9450c6e38e tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f3540ad9790>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:03.806586 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0a4405b7-e1a1-4282-bd87-3c9450c6e38e tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c" status: 202 len: 0 microversion: 2.1 time: 0.068240 Jul 21 21:05:03.807157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 541/1080] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 21:05:03 2022] DELETE /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:05:03.815239 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1c8876cf-8091-4fce-ba39-f76966598964 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f354019aa60>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:03.865346 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1c8876cf-8091-4fce-ba39-f76966598964 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c" status: 200 len: 345 microversion: 2.1 time: 0.053822 Jul 21 21:05:03.865999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 540/1081] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:05:03 2022] GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:03.955811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:03.956287 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:03.958169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:03.964879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:03.965334 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:03.966104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:03.966543 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:04.125311 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2bc1eb1eb845ec82b79adee04a51e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51d3542adae4062a487ab85d673140d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:04.133083 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2fd6f2b7-6727-461b-89e6-3a05879b2aeb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 200 len: 1673 microversion: 2.1 time: 0.181358 Jul 21 21:05:04.133924 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 542/1082] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:03 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:04.502504 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-bb28944f-1205-43a4-8f76-60e6d2b50619 req-3442b033-811b-4f35-be53-b68e5b71a821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012d5bba-82b3-4bf8-b491-d700fcf78cef", "name": "network-vif-deleted", "tag": "afce5e52-2f26-4fa4-947d-b22c511e5dd9"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:04.506706 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:04.514849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-bb28944f-1205-43a4-8f76-60e6d2b50619 req-3442b033-811b-4f35-be53-b68e5b71a821 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:04.515294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-bb28944f-1205-43a4-8f76-60e6d2b50619 req-3442b033-811b-4f35-be53-b68e5b71a821 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:04.518790 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:04.531560 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-bb28944f-1205-43a4-8f76-60e6d2b50619 req-3442b033-811b-4f35-be53-b68e5b71a821 service nova] Creating event network-vif-deleted:afce5e52-2f26-4fa4-947d-b22c511e5dd9 for instance 012d5bba-82b3-4bf8-b491-d700fcf78cef on hv-cinder-85068 Jul 21 21:05:04.537152 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-bb28944f-1205-43a4-8f76-60e6d2b50619 req-3442b033-811b-4f35-be53-b68e5b71a821 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 Jul 21 21:05:04.538143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 541/1083] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:04.878503 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-877657f0-5b63-46f4-8398-214555868638 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f35402bc430>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:04.908673 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-877657f0-5b63-46f4-8398-214555868638 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] HTTP exception thrown: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-877657f0-5b63-46f4-8398-214555868638 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Request method failure captured: Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c HTTP/1.1 Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b92lEfAXTvgtPsl_huS1Im8SxpApmbKMgWPpA2-gj-SjWCGSmZvUisCuZbYe4xNuh0lgcH78Fq3MgL_w9zS_Y-jo8xMnVC7mH3upRXhJgvOvV_mExS0d52TWX4XgJzWoGqS6OXxrdsdJyr8NTWaxgwGKX1lROFNWsBPokyFZF8Qf_Q Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:05:04.912057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72d4aa110cf348049f72ae629879beea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 12941ff7dc2c42b18dcc5acfa79275c2 Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '6bf7c635-9cd5-46e5-a806-cbce9187167c'} Jul 21 21:05:04.913708 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. (HTTP 404) (Request-ID: req-dd7102cb-e21e-4ca2-a1f0-62249388b8c5) Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:04.914857 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:05:04.916395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 21:05:04.917687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-877657f0-5b63-46f4-8398-214555868638 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Returning 404 to user: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-877657f0-5b63-46f4-8398-214555868638 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c" status: 404 len: 109 microversion: 2.1 time: 0.040816 Jul 21 21:05:04.918850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 543/1084] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:05:04 2022] GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:04.933722 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-90fe5ce6-3bf9-4a5b-a49d-be3ee1a69928 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f354029f4c0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:04.969400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-90fe5ce6-3bf9-4a5b-a49d-be3ee1a69928 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] HTTP exception thrown: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-90fe5ce6-3bf9-4a5b-a49d-be3ee1a69928 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Request method failure captured: Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c HTTP/1.1 Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b92lEfAXTvgtPsl_huS1Im8SxpApmbKMgWPpA2-gj-SjWCGSmZvUisCuZbYe4xNuh0lgcH78Fq3MgL_w9zS_Y-jo8xMnVC7mH3upRXhJgvOvV_mExS0d52TWX4XgJzWoGqS6OXxrdsdJyr8NTWaxgwGKX1lROFNWsBPokyFZF8Qf_Q Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:05:04.971471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72d4aa110cf348049f72ae629879beea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 12941ff7dc2c42b18dcc5acfa79275c2 Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '6bf7c635-9cd5-46e5-a806-cbce9187167c'} Jul 21 21:05:04.973058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. (HTTP 404) (Request-ID: req-b497d7c6-db27-4be1-a7fa-4c0650976fad) Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:04.973994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 21:05:04.975361 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 21:05:04.977922 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-90fe5ce6-3bf9-4a5b-a49d-be3ee1a69928 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Returning 404 to user: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-90fe5ce6-3bf9-4a5b-a49d-be3ee1a69928 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c" status: 404 len: 109 microversion: 2.1 time: 0.043790 Jul 21 21:05:04.979381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 542/1085] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 21:05:04 2022] DELETE /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:04.994288 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-60823537-b50e-4f4c-a640-77a5fee4c391 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Calling method '.version_select at 0x7f3540d8fa60>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:05.026288 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-60823537-b50e-4f4c-a640-77a5fee4c391 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] HTTP exception thrown: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-60823537-b50e-4f4c-a640-77a5fee4c391 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Request method failure captured: Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c HTTP/1.1 Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b92lEfAXTvgtPsl_huS1Im8SxpApmbKMgWPpA2-gj-SjWCGSmZvUisCuZbYe4xNuh0lgcH78Fq3MgL_w9zS_Y-jo8xMnVC7mH3upRXhJgvOvV_mExS0d52TWX4XgJzWoGqS6OXxrdsdJyr8NTWaxgwGKX1lROFNWsBPokyFZF8Qf_Q Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:05:05.028286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72d4aa110cf348049f72ae629879beea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72d4aa110cf348049f72ae629879beea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72d4aa110cf348049f72ae629879beea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 72d4aa110cf348049f72ae629879beea Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-563214051 Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 12941ff7dc2c42b18dcc5acfa79275c2 Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-563214051-project Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '6bf7c635-9cd5-46e5-a806-cbce9187167c'} Jul 21 21:05:05.029872 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. (HTTP 404) (Request-ID: req-11bade6c-0b36-4b3b-bae6-46c1499eca62) Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:05.030797 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:05:05.032027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 21:05:05.033174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-60823537-b50e-4f4c-a640-77a5fee4c391 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] Returning 404 to user: Volume 6bf7c635-9cd5-46e5-a806-cbce9187167c could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-60823537-b50e-4f4c-a640-77a5fee4c391 tempest-VolumesSnapshotsTestJSON-563214051 tempest-VolumesSnapshotsTestJSON-563214051-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c" status: 404 len: 109 microversion: 2.1 time: 0.040051 Jul 21 21:05:05.034350 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 544/1086] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:05:04 2022] GET /compute/v2.1/os-volumes/6bf7c635-9cd5-46e5-a806-cbce9187167c => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:05.151890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:05.153139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:05.161318 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:05.161764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:05.162772 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:05.163390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:05.177674 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] HTTP exception thrown: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Request method failure captured: Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef HTTP/1.1 Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b0etTfVWqRkg5EWCQlGrh6GY0sjSO7cKL9Wi7ZrgFhs2ci99jiNxzgIXyYH2J5hDKeMbXBzzJb7D9szoPnwhoIKsGdMEbLr9HQYaOAv4v8rBgNzsHbfd-Ne74GtIw0avJLwM15ulmfWpgXVLDA0MkeQCGNn297El8OJ7uCsjyfewBw Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:05:05.179193 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c51d3542adae4062a487ab85d673140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab2bc1eb1eb845ec82b79adee04a51e7 Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:05.180965 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '012d5bba-82b3-4bf8-b491-d700fcf78cef'} Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:05.181913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:05.183408 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:05.184827 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Returning 404 to user: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:05.184827 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-096141eb-8d28-4ab4-b830-037eb27755eb tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 404 len: 111 microversion: 2.1 time: 0.034199 Jul 21 21:05:05.185018 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 543/1087] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:05 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:05.190870 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ac49df7e-7a75-4f06-93e4-94b3c587e623 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '.version_select at 0x7f3540d8f670>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:05.213097 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ac49df7e-7a75-4f06-93e4-94b3c587e623 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994963326" status: 202 len: 0 microversion: 2.1 time: 0.026862 Jul 21 21:05:05.213822 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 545/1088] 10.222.0.60 () {58 vars in 1220 bytes} [Thu Jul 21 21:05:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994963326 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:05:08.285045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:08.285549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:08.292777 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:08.293188 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:08.293957 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:08.294403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:08.308355 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] HTTP exception thrown: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Request method failure captured: Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef HTTP/1.1 Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b0etTfVWqRkg5EWCQlGrh6GY0sjSO7cKL9Wi7ZrgFhs2ci99jiNxzgIXyYH2J5hDKeMbXBzzJb7D9szoPnwhoIKsGdMEbLr9HQYaOAv4v8rBgNzsHbfd-Ne74GtIw0avJLwM15ulmfWpgXVLDA0MkeQCGNn297El8OJ7uCsjyfewBw Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:05:08.309875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c51d3542adae4062a487ab85d673140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab2bc1eb1eb845ec82b79adee04a51e7 Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.311474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '012d5bba-82b3-4bf8-b491-d700fcf78cef'} Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:08.312379 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.313812 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.316166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Returning 404 to user: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:08.316166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0a372823-6e6b-42ff-9f03-bddcb64beee1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 404 len: 111 microversion: 2.1 time: 0.030217 Jul 21 21:05:08.316166 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 544/1089] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:05:08 2022] DELETE /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:08.319743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:08.320368 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 012d5bba-82b3-4bf8-b491-d700fcf78cef] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:08.328104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:08.328622 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:08.329507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:08.329954 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:08.344164 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] HTTP exception thrown: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Request method failure captured: Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef HTTP/1.1 Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b0etTfVWqRkg5EWCQlGrh6GY0sjSO7cKL9Wi7ZrgFhs2ci99jiNxzgIXyYH2J5hDKeMbXBzzJb7D9szoPnwhoIKsGdMEbLr9HQYaOAv4v8rBgNzsHbfd-Ne74GtIw0avJLwM15ulmfWpgXVLDA0MkeQCGNn297El8OJ7uCsjyfewBw Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:05:08.345705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c51d3542adae4062a487ab85d673140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: ab2bc1eb1eb845ec82b79adee04a51e7 Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.347317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '012d5bba-82b3-4bf8-b491-d700fcf78cef'} Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:08.348222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. Jul 21 21:05:08.349517 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:08.350785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Returning 404 to user: Instance 012d5bba-82b3-4bf8-b491-d700fcf78cef could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:08.350785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d4310e2a-a81b-41e4-9036-362b9623c1a5 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef" status: 404 len: 111 microversion: 2.1 time: 0.031196 Jul 21 21:05:08.350785 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 546/1090] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:08 2022] GET /compute/v2.1/servers/012d5bba-82b3-4bf8-b491-d700fcf78cef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 21:05:09.498373 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:09.498890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:09.505430 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:09.505868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:09.506616 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:09.507044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:09.522885 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] HTTP exception thrown: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Request method failure captured: Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 HTTP/1.1 Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b0etTfVWqRkg5EWCQlGrh6GY0sjSO7cKL9Wi7ZrgFhs2ci99jiNxzgIXyYH2J5hDKeMbXBzzJb7D9szoPnwhoIKsGdMEbLr9HQYaOAv4v8rBgNzsHbfd-Ne74GtIw0avJLwM15ulmfWpgXVLDA0MkeQCGNn297El8OJ7uCsjyfewBw Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:05:09.524991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c51d3542adae4062a487ab85d673140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: ab2bc1eb1eb845ec82b79adee04a51e7 Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.526610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '71a0918b-9ae2-48d6-943a-bff67b0e7ca6'} Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:09.527741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.529243 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.530747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Returning 404 to user: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:09.530747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-97866ddb-4fe6-4b2b-8e2b-53cd997179d1 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 404 len: 111 microversion: 2.1 time: 0.032302 Jul 21 21:05:09.530747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 545/1091] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:05:09 2022] DELETE /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:09.535899 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:09.536521 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] [instance: 71a0918b-9ae2-48d6-943a-bff67b0e7ca6] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:09.543861 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:09.544327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:09.545525 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:09.545968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:09.560110 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] HTTP exception thrown: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Request method failure captured: Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 HTTP/1.1 Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b0etTfVWqRkg5EWCQlGrh6GY0sjSO7cKL9Wi7ZrgFhs2ci99jiNxzgIXyYH2J5hDKeMbXBzzJb7D9szoPnwhoIKsGdMEbLr9HQYaOAv4v8rBgNzsHbfd-Ne74GtIw0avJLwM15ulmfWpgXVLDA0MkeQCGNn297El8OJ7uCsjyfewBw Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:05:09.561638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c51d3542adae4062a487ab85d673140d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c51d3542adae4062a487ab85d673140d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c51d3542adae4062a487ab85d673140d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: c51d3542adae4062a487ab85d673140d Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-835058262 Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: ab2bc1eb1eb845ec82b79adee04a51e7 Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeTestJSON-835058262-project Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.564279 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '71a0918b-9ae2-48d6-943a-bff67b0e7ca6'} Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:05:09.565224 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. Jul 21 21:05:09.566776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:05:09.569626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] Returning 404 to user: Instance 71a0918b-9ae2-48d6-943a-bff67b0e7ca6 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:05:09.569626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-51385e9f-e868-43f4-8328-d85c71ffe886 tempest-AttachVolumeTestJSON-835058262 tempest-AttachVolumeTestJSON-835058262-project] 10.222.0.60 "GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6" status: 404 len: 111 microversion: 2.1 time: 0.030988 Jul 21 21:05:09.569626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 547/1092] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:09 2022] GET /compute/v2.1/servers/71a0918b-9ae2-48d6-943a-bff67b0e7ca6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:05:18.817045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7772d422-178c-4a31-bde6-82b446118008 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: .version_select at 0x7f35449f7550>, body: {"keypair": {"name": "tempest-keypair-1767041971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFown0vepErgJ1pLAuJ9e4dUKLQT+rgMBASvemz3R/gV+kJYhT+Bx6hmgFrSYTuFAk8eRziA1DWghLjQ3+y6t7cp2f1vVj/OUwSS8idDkvxTQBTowzCobbGCqmhNZzcYoQ=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:18.840474 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-7772d422-178c-4a31-bde6-82b446118008 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:05:18.846480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-7772d422-178c-4a31-bde6-82b446118008 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:05:18.879779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7772d422-178c-4a31-bde6-82b446118008 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.220491 Jul 21 21:05:18.886770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 546/1093] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 21:05:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:20.551968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-746791672", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a056bea-ebfc-41ce-8004-0588675751ae"}], "security_groups": [{"name": "tempest-securitygroup--174149221"}], "key_name": "tempest-keypair-1767041971", "user_data": "}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:20.559197 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:20.559938 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=30 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:20.684744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] validate_networks() for [('9a056bea-ebfc-41ce-8004-0588675751ae', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:05:21.119798 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:05:21.120233 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:05:21.120705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:05:21.121133 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:05:21.121762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:05:21.130997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:21.131466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:21.132366 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:21.133438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:21.153171 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:05:21.157392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:05:21.170991 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:05:21.173298 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:05:21.223898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-98806655-08d2-4096-81c0-def08e890256 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676241 Jul 21 21:05:21.224564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 548/1094] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:05:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:05:21.237582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-331263c3-8393-4ca2-b423-b3934a0466e1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:21.239391 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-331263c3-8393-4ca2-b423-b3934a0466e1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:21.241611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=7 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:21.319576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-331263c3-8393-4ca2-b423-b3934a0466e1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:21.327947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-331263c3-8393-4ca2-b423-b3934a0466e1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1241 microversion: 2.1 time: 0.095837 Jul 21 21:05:21.338380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 547/1095] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:21 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:22.346395 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:22.347928 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:22.358794 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:22.359508 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:22.360660 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:22.361264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:22.439079 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:22.447486 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7f0cbedd-798e-464b-89e1-351e9a987d52 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1237 microversion: 2.1 time: 0.106267 Jul 21 21:05:22.448200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 549/1096] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:22 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:23.465046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:23.465666 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:23.472069 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:23.472521 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:23.473286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:23.473756 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:23.547400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:23.555653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-70e36bda-7c07-42f9-b420-1d4ac14b1a50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1299 microversion: 2.1 time: 0.094191 Jul 21 21:05:23.557155 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 548/1097] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:23 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:24.573360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:24.573978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:24.580569 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:24.581022 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:24.581803 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:24.582247 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:24.711069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:24.718537 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1bfdb64a-2925-48a4-b8a5-bf606b81ce95 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.149383 Jul 21 21:05:24.719099 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 550/1098] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:24 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:25.735604 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:25.736163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:25.742818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:25.743274 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:25.744056 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:25.744489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:25.875347 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:25.883315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-444951a2-fb0e-47d8-8353-b1943fc8811e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.150980 Jul 21 21:05:25.884059 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 549/1099] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:25 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:05:26.900901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:26.901469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:26.907922 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:26.908550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:26.909321 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:26.909754 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:27.041472 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:27.048839 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b293cc99-81d7-4f53-a121-7540b7597370 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.152517 Jul 21 21:05:27.049404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 551/1100] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:26 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:28.066519 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:28.067146 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:28.074547 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:28.075005 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:28.075807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:28.076246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:28.148341 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-2e90464d-e262-470e-9b51-0a97f740a075 req-c3a2409c-a4c8-4bc2-8108-98174e372381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfb563f-9476-4097-bdb1-5009aa10a622", "tag": "c7c81f7a-fe16-46f7-a7e9-8f5533d58a01"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:28.173444 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-2e90464d-e262-470e-9b51-0a97f740a075 req-c3a2409c-a4c8-4bc2-8108-98174e372381 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:28.173898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-2e90464d-e262-470e-9b51-0a97f740a075 req-c3a2409c-a4c8-4bc2-8108-98174e372381 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:28.190275 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-2e90464d-e262-470e-9b51-0a97f740a075 req-c3a2409c-a4c8-4bc2-8108-98174e372381 service nova] Creating event network-changed:c7c81f7a-fe16-46f7-a7e9-8f5533d58a01 for instance bbfb563f-9476-4097-bdb1-5009aa10a622 on hv-cinder-85068 Jul 21 21:05:28.196821 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-2e90464d-e262-470e-9b51-0a97f740a075 req-c3a2409c-a4c8-4bc2-8108-98174e372381 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067528 Jul 21 21:05:28.198206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 552/1101] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:05:28.435102 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:28.442551 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7bf94324-1d15-4825-8387-db564636b659 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.380064 Jul 21 21:05:28.443042 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 550/1102] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:28 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:29.129911 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-647504e2-cca7-43df-bc15-f4016450ba45 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:29.130948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-647504e2-cca7-43df-bc15-f4016450ba45 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:29.137885 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-647504e2-cca7-43df-bc15-f4016450ba45 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:29.138344 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-647504e2-cca7-43df-bc15-f4016450ba45 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:29.139117 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-647504e2-cca7-43df-bc15-f4016450ba45 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:29.139585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-647504e2-cca7-43df-bc15-f4016450ba45 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:29.209852 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-647504e2-cca7-43df-bc15-f4016450ba45 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/action" status: 202 len: 0 microversion: 2.1 time: 0.084010 Jul 21 21:05:29.210587 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 553/1103] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 21:05:29 2022] POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:05:29.218715 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:29.220624 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:29.227438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:29.227929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:29.228701 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:29.229138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:29.371955 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:29.379875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c4ff07f1-4484-48d3-ae26-75e9ad27434b tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1752 microversion: 2.1 time: 0.165148 Jul 21 21:05:29.380438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 551/1104] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:29 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:29.460326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:29.461550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:29.467930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:29.468247 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:29.469010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:29.469445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:29.605005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:29.612609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-1da700df-2bb1-434b-bcb3-0f4a91201128 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.156465 Jul 21 21:05:29.613174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 554/1105] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:29 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:30.398128 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:30.399489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:30.406273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:30.406718 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:30.407485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:30.407953 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:30.550448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:30.558497 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8085f837-b568-48a4-a7ff-fad68a16f023 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1752 microversion: 2.1 time: 0.164337 Jul 21 21:05:30.559055 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 552/1106] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:30 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:30.632122 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:30.636850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:30.640645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:30.641104 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:30.641881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:30.642326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:30.775229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:30.782592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6f90d299-27dc-4313-99f1-dee5ef7f7da8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.156596 Jul 21 21:05:30.783165 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 555/1107] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:30 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:31.575816 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:31.576418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:31.578228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:31.583538 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:31.584012 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:31.584771 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:31.585198 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:31.800787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:31.801758 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:31.803094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:31.805991 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:31.807496 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:31.809385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6807a771-598d-4e0b-96c0-8bf2e885d1e4 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1752 microversion: 2.1 time: 0.237544 Jul 21 21:05:31.810244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 553/1108] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:31 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1752 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:31.819995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:31.819995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:31.819995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:31.819995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:31.966554 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:31.976827 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4a1ed7a3-5e89-4fe8-a97c-ddd098a54381 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.179817 Jul 21 21:05:31.986895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 556/1109] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:31 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:32.827953 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:32.828556 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:32.843064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:32.843515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:32.844333 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:32.844770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:32.996225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:32.996846 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:33.003671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:33.004162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:33.004940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:33.005623 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:33.029270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:33.037609 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1a6c6ff0-d506-4e3a-8fed-13da86ce1efb tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1752 microversion: 2.1 time: 0.213521 Jul 21 21:05:33.038459 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 554/1110] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:32 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:33.168170 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:33.177069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5c537715-5485-4df6-8352-2a7e6a9f192d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.186734 Jul 21 21:05:33.177753 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 557/1111] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:32 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:05:34.057125 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:34.057836 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:34.064380 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:34.064835 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:34.065804 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:34.066245 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:34.195515 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:34.196221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:34.204129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:34.204684 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:34.205600 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:34.206141 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:34.359823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:34.372853 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cf7bdcf0-a053-423e-9779-ca0d89e25ff7 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 0.319689 Jul 21 21:05:34.374364 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 555/1112] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:34 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:34.663645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:34.671737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4ce02112-b4c8-46ab-b273-fb1a97d7c951 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.481057 Jul 21 21:05:34.672657 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 558/1113] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:34 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:05:35.391035 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:35.391675 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:35.394458 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:35.400597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:35.401058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:35.401856 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:35.402298 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:35.593322 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:35.605582 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-510bf372-f8e9-462b-b50f-c268bfd44d66 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 0.218263 Jul 21 21:05:35.615375 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 556/1114] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:35 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:35.689743 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:35.690293 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:35.698040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:35.698626 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:35.699627 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:35.700336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:35.936320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:35.947751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2f17817a-a9b4-4035-9e97-2c27b01c88bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.261352 Jul 21 21:05:35.948360 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 559/1115] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:35 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:36.469369 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-fd8b2774-e2c4-43c1-8481-f8b843d029ea req-41e66995-09a3-4b7f-a814-7615e10b5629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfb563f-9476-4097-bdb1-5009aa10a622", "name": "network-vif-plugged", "status": "completed", "tag": "c7c81f7a-fe16-46f7-a7e9-8f5533d58a01"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:36.480693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-fd8b2774-e2c4-43c1-8481-f8b843d029ea req-41e66995-09a3-4b7f-a814-7615e10b5629 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:36.481234 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-fd8b2774-e2c4-43c1-8481-f8b843d029ea req-41e66995-09a3-4b7f-a814-7615e10b5629 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:36.497990 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-fd8b2774-e2c4-43c1-8481-f8b843d029ea req-41e66995-09a3-4b7f-a814-7615e10b5629 service nova] Creating event network-vif-plugged:c7c81f7a-fe16-46f7-a7e9-8f5533d58a01 for instance bbfb563f-9476-4097-bdb1-5009aa10a622 on hv-cinder-85068 Jul 21 21:05:36.505172 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-fd8b2774-e2c4-43c1-8481-f8b843d029ea req-41e66995-09a3-4b7f-a814-7615e10b5629 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046791 Jul 21 21:05:36.506216 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 557/1116] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:36.623561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:36.624209 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:36.638416 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:36.638645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:36.641923 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:36.647859 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:36.953223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:36.964573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-27845c3e-6225-4852-9843-1dbd2c69e3e2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 0.344960 Jul 21 21:05:36.965585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 560/1117] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:36 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:36.967662 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:36.968687 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:36.975537 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:36.976916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:36.978842 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:36.979975 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:37.139263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:37.146841 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8203bc45-1e0a-414e-8f62-b60e32fc5f65 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.185940 Jul 21 21:05:37.147409 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 558/1118] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:36 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:37.982555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:37.983178 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:37.989877 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:37.990328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:37.991116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:37.991540 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:38.164876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:38.166331 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:38.175932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:38.176375 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:38.177148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:38.177579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:38.229578 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:38.244454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-64e62537-35b4-4036-9ebc-22e066eda620 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 0.265435 Jul 21 21:05:38.245698 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 561/1119] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:37 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:38.333643 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:38.342063 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-14b91e4b-67a3-4360-ae70-b1903791ea90 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1366 microversion: 2.1 time: 0.180962 Jul 21 21:05:38.342653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 559/1120] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:38 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:39.263034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:39.263964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:39.270481 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:39.271199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:39.272013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:39.272671 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:39.370606 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:39.371980 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:39.380560 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:39.381465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:39.382326 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:39.382861 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:39.546480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:39.555133 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4e51c70f-989d-4fba-a17f-4ef9f810079a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1555 microversion: 2.1 time: 0.198812 Jul 21 21:05:39.557315 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 560/1121] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:39 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:39.567677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:39.586476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-699e907d-01ae-4270-9d81-75c504f50702 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:39.588212 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-699e907d-01ae-4270-9d81-75c504f50702 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:39.589116 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b99f6972-3ee0-45e1-8010-c5e4cbcb2d50 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 0.330992 Jul 21 21:05:39.593073 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 562/1122] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:39 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:39.597641 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-699e907d-01ae-4270-9d81-75c504f50702 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:39.598108 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-699e907d-01ae-4270-9d81-75c504f50702 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:39.598902 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-699e907d-01ae-4270-9d81-75c504f50702 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:39.599549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-699e907d-01ae-4270-9d81-75c504f50702 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:39.709089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-699e907d-01ae-4270-9d81-75c504f50702 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136276 Jul 21 21:05:39.711297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 561/1123] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 21:05:39 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:40.607305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:40.607905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:40.620522 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:40.620983 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:40.621784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:40.627229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:41.614581 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-b2989a39-7650-44ac-9a2d-fc7508589ed6 req-5a940b13-4f21-4587-8f0b-55e281029442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfb563f-9476-4097-bdb1-5009aa10a622", "tag": "c7c81f7a-fe16-46f7-a7e9-8f5533d58a01"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:41.624385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-b2989a39-7650-44ac-9a2d-fc7508589ed6 req-5a940b13-4f21-4587-8f0b-55e281029442 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:41.625263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-b2989a39-7650-44ac-9a2d-fc7508589ed6 req-5a940b13-4f21-4587-8f0b-55e281029442 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:41.641309 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-b2989a39-7650-44ac-9a2d-fc7508589ed6 req-5a940b13-4f21-4587-8f0b-55e281029442 service nova] Creating event network-changed:c7c81f7a-fe16-46f7-a7e9-8f5533d58a01 for instance bbfb563f-9476-4097-bdb1-5009aa10a622 on hv-cinder-85068 Jul 21 21:05:41.650429 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-b2989a39-7650-44ac-9a2d-fc7508589ed6 req-5a940b13-4f21-4587-8f0b-55e281029442 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038440 Jul 21 21:05:41.655557 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 562/1124] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:05:41.735880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:41.748414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-175c04fe-c37e-454a-9b6f-b66b2a8bdebf tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 1.145620 Jul 21 21:05:41.749335 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 563/1125] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:40 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:42.769278 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:42.770584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:42.791190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:42.791800 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:42.792739 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:42.793167 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:43.072327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:43.082300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7e76a9e4-cc8e-4e7c-a92d-4d4f37951360 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 0.320375 Jul 21 21:05:43.083115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 563/1126] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:42 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:43.819879 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-266a417c-0c84-41d1-ae15-8da347789c8e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Action: 'create', calling method: .version_select at 0x7f3540c2a160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1811122096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhW8E9/A5FQ9S0LFj8LLvbrYjT8EpVOHiGb1jXngBt4xfqqPHJV2Bqpk5yDZkAG6ZoFFe54xSe4FG9Cg6rv2IHmWX1htbF8gPYANcUwxs94bCew5qW6EG52YOUKFaz2Wg=="}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:05:43.838566 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-266a417c-0c84-41d1-ae15-8da347789c8e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Getting quotas for project 91eaf4caa6ea457bafa7de7a1387851c. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:05:43.842892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-266a417c-0c84-41d1-ae15-8da347789c8e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Getting quotas for user f06aae5f002d46a3a60100c908d07455 and project 91eaf4caa6ea457bafa7de7a1387851c. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:05:43.869320 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-266a417c-0c84-41d1-ae15-8da347789c8e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.224351 Jul 21 21:05:43.874763 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 564/1127] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 21:05:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:05:44.099915 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:44.101109 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:44.108287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:44.108740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:44.109529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:44.109966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:44.304815 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:44.313620 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-710a85c8-0a13-4883-be15-1feef0bdcd9d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1757 microversion: 2.1 time: 0.217628 Jul 21 21:05:44.314200 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 564/1128] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:44 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:05:45.332617 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:05:45.333960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:05:45.342962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:45.343461 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:45.344336 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:05:45.344780 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:05:45.526026 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:05:45.530004 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:05:45.536241 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-7b676bc6-52f8-42ac-915a-070c72d38160 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1760 microversion: 2.1 time: 0.208312 Jul 21 21:05:45.536861 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 565/1129] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:05:45 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1760 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:10.708415 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1884864799", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1811122096", "security_groups": [{"name": "tempest-secgroup-smoke-606706081"}], "networks": [{"uuid": "6e269719-65b6-4f5a-a60a-17796016ca87"}], "block_device_mapping_v2": [{"uuid": "241d4b0d-d0ec-4f4c-a8ef-b8fa8fd0640f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:10.717352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=17 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:10.718005 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=92 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:10.819404 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] validate_networks() for [('6e269719-65b6-4f5a-a60a-17796016ca87', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:06:11.284491 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:06:11.284916 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:06:11.285390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:06:11.285803 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:06:11.286241 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:06:11.295081 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:11.295525 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:11.296347 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:11.296780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:11.314229 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Getting quotas for project 91eaf4caa6ea457bafa7de7a1387851c. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:06:11.318144 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Getting quotas for user f06aae5f002d46a3a60100c908d07455 and project 91eaf4caa6ea457bafa7de7a1387851c. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:06:11.374218 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:06:11.376365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='241d4b0d-d0ec-4f4c-a8ef-b8fa8fd0640f',volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:06:11.501763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-294ca254-3109-4c7b-9904-b912633532e2 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.797148 Jul 21 21:06:11.502405 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 565/1130] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:06:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:06:11.520180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e5f7b415-59da-4beb-b295-34f73facb2e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:11.521302 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e5f7b415-59da-4beb-b295-34f73facb2e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:11.525226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=4 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:11.526299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:11.589593 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e5f7b415-59da-4beb-b295-34f73facb2e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:11.597343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e5f7b415-59da-4beb-b295-34f73facb2e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1089 microversion: 2.1 time: 0.084237 Jul 21 21:06:11.597937 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 566/1131] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:11 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:12.614774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:12.615420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:12.623505 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:12.623981 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:12.624757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:12.625226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:12.686403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:12.693874 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-95e279d6-929a-44ac-a0ac-a1c893a1a039 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1187 microversion: 2.1 time: 0.083033 Jul 21 21:06:12.694446 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 566/1132] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:12 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:13.711649 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:13.713154 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:13.720694 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:13.721145 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:13.722127 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:13.722574 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:13.874895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:13.883161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-44becb0f-4dd4-4549-b690-a6b26b455478 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1272 microversion: 2.1 time: 0.175473 Jul 21 21:06:13.884040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 567/1133] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:13 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:14.282052 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-b90174d1-c7f5-4e9f-bf3f-069d64d50339 req-1e78663d-dfec-4fa0-905b-8af7102643c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17eea1a-2a7e-4d9f-a0a3-198c91480e71", "tag": "6d6d5ecd-8d57-4f55-8259-b5e620742bac"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:14.304084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-b90174d1-c7f5-4e9f-bf3f-069d64d50339 req-1e78663d-dfec-4fa0-905b-8af7102643c0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:14.304617 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-b90174d1-c7f5-4e9f-bf3f-069d64d50339 req-1e78663d-dfec-4fa0-905b-8af7102643c0 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:14.318947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-b90174d1-c7f5-4e9f-bf3f-069d64d50339 req-1e78663d-dfec-4fa0-905b-8af7102643c0 service nova] Creating event network-changed:6d6d5ecd-8d57-4f55-8259-b5e620742bac for instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 on hv-cinder-85068 Jul 21 21:06:14.324876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-b90174d1-c7f5-4e9f-bf3f-069d64d50339 req-1e78663d-dfec-4fa0-905b-8af7102643c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046813 Jul 21 21:06:14.326443 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 567/1134] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:06:14.901994 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:14.902618 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:14.909001 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:14.909449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:14.910211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:14.910653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:15.041623 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:15.049624 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d5144f8f-42fe-4537-a7ef-de7c03b4476b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.152222 Jul 21 21:06:15.050193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 568/1135] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:14 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:16.066781 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:16.067472 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:16.074829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:16.075277 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:16.076092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:16.076515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:16.297705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:16.305251 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b3e56674-4cd8-4506-97b2-39a5155dca31 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.242598 Jul 21 21:06:16.305825 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 568/1136] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:16 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:17.322366 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:17.323162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:17.329641 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:17.330159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:17.330914 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:17.331343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:17.466408 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:17.473896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e7d29a62-aa4b-4719-8fb6-c3e6545fe880 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.155406 Jul 21 21:06:17.474670 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 569/1137] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:17 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:18.491231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:18.491895 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:18.499267 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:18.499736 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:18.500515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:18.500952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:18.638083 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:18.645543 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5bf3f9d4-2813-4864-b8bf-7c1c5b51f565 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.158154 Jul 21 21:06:18.646106 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 569/1138] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:18 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:19.662349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:19.662904 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:19.669927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:19.670377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:19.671144 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:19.671583 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:19.798682 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:19.806240 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-06aed04b-432b-4316-aee9-b9d730b7f52e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.147806 Jul 21 21:06:19.806811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 570/1139] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:19 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:20.826477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:20.827082 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:20.834832 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:20.835321 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:20.836104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:20.836544 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:20.968684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:20.976195 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f717e00a-4813-40fa-aac8-02c712a6ab1b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.155938 Jul 21 21:06:20.976765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 570/1140] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:20 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:21.993984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:21.995232 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:21.997644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:22.003665 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:22.004141 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:22.004913 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:22.005349 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:22.145605 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:22.153750 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e8e69670-0878-4439-8b1a-a648855c1b91 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.163907 Jul 21 21:06:22.154332 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 571/1141] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:21 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:22.304937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:22.311740 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-dcf8a96f-68d4-4b98-bbd8-1414472e540b req-7e397d69-cecb-4816-bfd1-820580bd64d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ea1535-d7da-47de-b2e3-dec03f1b4eea", "tag": "ef105c38-7ca3-4dca-bf85-93202680ca37"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:22.311940 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:22.314051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:22.318839 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:22.325091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:22.325542 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:22.326323 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:22.326763 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:22.334832 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-dcf8a96f-68d4-4b98-bbd8-1414472e540b req-7e397d69-cecb-4816-bfd1-820580bd64d7 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:22.335363 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-dcf8a96f-68d4-4b98-bbd8-1414472e540b req-7e397d69-cecb-4816-bfd1-820580bd64d7 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:22.347742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-dcf8a96f-68d4-4b98-bbd8-1414472e540b req-7e397d69-cecb-4816-bfd1-820580bd64d7 service nova] Creating event network-changed:ef105c38-7ca3-4dca-bf85-93202680ca37 for instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea on hv-cinder-85068 Jul 21 21:06:22.354721 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-dcf8a96f-68d4-4b98-bbd8-1414472e540b req-7e397d69-cecb-4816-bfd1-820580bd64d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046324 Jul 21 21:06:22.355871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 572/1142] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:06:22.357831 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:06:22.458292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b9606de5-56f5-4465-9657-38ed183645b4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "DELETE /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 204 len: 0 microversion: 2.1 time: 0.156960 Jul 21 21:06:22.459213 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 571/1143] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:06:22 2022] DELETE /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 21:06:22.469433 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:22.470143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:22.476518 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:22.476975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:22.477758 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:22.478202 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:22.615742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:22.624115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2ca74fd7-0849-446a-924a-12ed644904bf tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1579 microversion: 2.1 time: 0.159267 Jul 21 21:06:22.624805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 573/1144] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:22 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:06:23.171067 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:23.171793 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:23.178181 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:23.178627 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:23.179406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:23.179866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:23.319178 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:23.328290 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6d75ef4f-6622-4b23-80f5-08b014f37a76 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.161393 Jul 21 21:06:23.328874 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 572/1145] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:23 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:23.642432 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:23.642969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:23.649463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:23.649918 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:23.650678 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:23.651280 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:23.789313 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:23.797417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6e7f1a56-0c0b-42be-8141-d24502a7a14d tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1579 microversion: 2.1 time: 0.158917 Jul 21 21:06:23.797997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 574/1146] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:23 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:24.345418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:24.346035 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:24.352577 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:24.353029 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:24.353794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:24.354733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:24.487549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:24.496156 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-36063a9f-ea3f-47d1-aec6-64203fb85d2b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.154428 Jul 21 21:06:24.496724 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 573/1147] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:24 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:24.814885 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:24.815505 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:24.821916 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:24.822370 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:24.824005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:24.824636 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:24.959466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:24.967766 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-4b8bfe57-58a4-4d44-8d2d-224ca7ed0ec8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1579 microversion: 2.1 time: 0.156752 Jul 21 21:06:24.968365 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 575/1148] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:24 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:25.513648 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:25.514238 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:25.520645 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:25.521095 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:25.521854 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:25.522485 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:25.690984 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-cde805ec-cf2c-4a2a-b6f2-451212307153 req-82e41502-c2ef-4fb4-bf82-a2aaa113de05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ea1535-d7da-47de-b2e3-dec03f1b4eea", "name": "network-vif-deleted", "tag": "ef105c38-7ca3-4dca-bf85-93202680ca37"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:25.700526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-cde805ec-cf2c-4a2a-b6f2-451212307153 req-82e41502-c2ef-4fb4-bf82-a2aaa113de05 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:25.700968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-cde805ec-cf2c-4a2a-b6f2-451212307153 req-82e41502-c2ef-4fb4-bf82-a2aaa113de05 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:25.712431 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-cde805ec-cf2c-4a2a-b6f2-451212307153 req-82e41502-c2ef-4fb4-bf82-a2aaa113de05 service nova] Creating event network-vif-deleted:ef105c38-7ca3-4dca-bf85-93202680ca37 for instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea on hv-cinder-85068 Jul 21 21:06:25.718175 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-cde805ec-cf2c-4a2a-b6f2-451212307153 req-82e41502-c2ef-4fb4-bf82-a2aaa113de05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030876 Jul 21 21:06:25.718784 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 576/1149] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:06:25.731264 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:25.738947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-73028f79-538d-435d-bc75-959fc4f4a823 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.229867 Jul 21 21:06:25.739509 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 574/1150] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:25 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:25.986427 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:25.987134 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:25.993726 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:25.994501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:25.996172 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:25.996845 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:26.071565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:26.080737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bffc720c-47bd-4e88-8c8a-8010c69aaca0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 200 len: 1226 microversion: 2.1 time: 0.098864 Jul 21 21:06:26.082969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-133eb281-c3ce-4886-8e39-56008660c825 req-285e722d-db84-4c6b-bf29-c72440beaf2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17eea1a-2a7e-4d9f-a0a3-198c91480e71", "name": "network-vif-plugged", "status": "completed", "tag": "6d6d5ecd-8d57-4f55-8259-b5e620742bac"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:26.091524 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 577/1151] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:25 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:26.097584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-133eb281-c3ce-4886-8e39-56008660c825 req-285e722d-db84-4c6b-bf29-c72440beaf2e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:26.098316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-133eb281-c3ce-4886-8e39-56008660c825 req-285e722d-db84-4c6b-bf29-c72440beaf2e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:26.113663 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-133eb281-c3ce-4886-8e39-56008660c825 req-285e722d-db84-4c6b-bf29-c72440beaf2e service nova] Creating event network-vif-plugged:6d6d5ecd-8d57-4f55-8259-b5e620742bac for instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 on hv-cinder-85068 Jul 21 21:06:26.118810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-133eb281-c3ce-4886-8e39-56008660c825 req-285e722d-db84-4c6b-bf29-c72440beaf2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039454 Jul 21 21:06:26.120325 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 575/1152] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:06:26.756314 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:26.756927 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:26.762995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:26.763439 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:26.764222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:26.764655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:26.894695 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:26.902881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8bcded53-1e82-45d3-a3bd-1d73f05217b0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.150494 Jul 21 21:06:26.903466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 578/1153] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:26 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:27.098311 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:27.099016 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 73ea1535-d7da-47de-b2e3-dec03f1b4eea] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:27.106000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:27.106456 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:27.107226 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:27.107668 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:27.123052 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] HTTP exception thrown: Instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea could not be found. Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Request method failure captured: Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea HTTP/1.1 Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b1r1hcyiSTWwswaD4oU87V_Ol743LFKzlceCa4YCWBJVV_5Bi6q9FzRaucZCGkXv8NjYTjG5BexJOqymLeRU6ElWcs24VNv-_5U18mhGY9EFKkib1Op0kY-oXuAlN8PEaAcI4saLdNZxZnduAF7jy3zG5Fcb04KPIkbwYYiJQnewD4 Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:06:27.124700 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 2b3617b8bcac4227b1295e294eec664a Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea could not be found. Jul 21 21:06:27.126387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '73ea1535-d7da-47de-b2e3-dec03f1b4eea'} Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea could not be found. Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:06:27.127263 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea could not be found. Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea could not be found. Jul 21 21:06:27.128855 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:27.130228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Returning 404 to user: Instance 73ea1535-d7da-47de-b2e3-dec03f1b4eea could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:06:27.130228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1b65ce83-d298-44d3-838c-910da0b9b357 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea" status: 404 len: 111 microversion: 2.1 time: 0.032462 Jul 21 21:06:27.130228 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 576/1154] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:27 2022] GET /compute/v2.1/servers/73ea1535-d7da-47de-b2e3-dec03f1b4eea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:06:27.920565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:27.921262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:27.927873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:27.928406 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:27.929266 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:27.929771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:28.068286 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:28.075779 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-eb2a4619-757d-4d44-8157-83e6fae926e7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1260 microversion: 2.1 time: 0.159866 Jul 21 21:06:28.076353 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 579/1155] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:27 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:29.093303 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:29.094033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:29.100639 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:29.101092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:29.101891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:29.102332 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:29.312721 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:29.320388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6e2e16eb-a2c0-4149-bd76-fcd95299009e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1444 microversion: 2.1 time: 0.231525 Jul 21 21:06:29.320897 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 577/1156] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:29 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1444 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:29.336372 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:29.336990 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:29.344074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:29.344532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:29.345663 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:29.345767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:29.482464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:29.490025 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5e87355e-ae16-4d90-8e12-bce0e4d3cfe6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1444 microversion: 2.1 time: 0.157434 Jul 21 21:06:29.490604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 580/1157] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:29 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:30.195610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:30.196728 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:30.197596 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-67e42d4c-686e-45e8-8e63-ddbd5a04f608 req-26c4225e-066a-442e-98eb-a2d8a35ad386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1a51f4-55bb-4e9b-9f33-05c4013f32e2", "tag": "09c78425-8076-4365-905c-544aaead3728"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:30.204983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:30.205735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:30.206082 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-67e42d4c-686e-45e8-8e63-ddbd5a04f608 req-26c4225e-066a-442e-98eb-a2d8a35ad386 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:30.206537 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-67e42d4c-686e-45e8-8e63-ddbd5a04f608 req-26c4225e-066a-442e-98eb-a2d8a35ad386 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:30.207155 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:30.207932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:30.219108 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-67e42d4c-686e-45e8-8e63-ddbd5a04f608 req-26c4225e-066a-442e-98eb-a2d8a35ad386 service nova] Creating event network-changed:09c78425-8076-4365-905c-544aaead3728 for instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 on hv-cinder-85068 Jul 21 21:06:30.225765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-67e42d4c-686e-45e8-8e63-ddbd5a04f608 req-26c4225e-066a-442e-98eb-a2d8a35ad386 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Jul 21 21:06:30.233511 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 581/1158] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:06:30.237420 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:06:30.347607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-10c83f38-13b6-446a-b9be-8239501738c3 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 204 len: 0 microversion: 2.1 time: 0.156150 Jul 21 21:06:30.351751 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 578/1159] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:06:30 2022] DELETE /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:06:30.358725 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:30.359563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:30.366094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:30.366676 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:30.367547 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:30.368367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:30.591399 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:30.600098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-efae49b5-8389-4270-99e6-b6122f08a9b8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1579 microversion: 2.1 time: 0.247007 Jul 21 21:06:30.611991 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 582/1160] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:30 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1579 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:31.383066 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-3c08abf9-b378-4ced-9a3a-b2d0f9fbd5e9 req-836ec02d-af96-49cd-afce-bcf0b0679544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17eea1a-2a7e-4d9f-a0a3-198c91480e71", "tag": "6d6d5ecd-8d57-4f55-8259-b5e620742bac"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:31.393691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3c08abf9-b378-4ced-9a3a-b2d0f9fbd5e9 req-836ec02d-af96-49cd-afce-bcf0b0679544 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:31.394259 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3c08abf9-b378-4ced-9a3a-b2d0f9fbd5e9 req-836ec02d-af96-49cd-afce-bcf0b0679544 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:31.410389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-3c08abf9-b378-4ced-9a3a-b2d0f9fbd5e9 req-836ec02d-af96-49cd-afce-bcf0b0679544 service nova] Creating event network-changed:6d6d5ecd-8d57-4f55-8259-b5e620742bac for instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 on hv-cinder-85068 Jul 21 21:06:31.415840 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-3c08abf9-b378-4ced-9a3a-b2d0f9fbd5e9 req-836ec02d-af96-49cd-afce-bcf0b0679544 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107551 Jul 21 21:06:31.417037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 579/1161] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:06:31.620770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:31.621739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:31.629655 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:31.630223 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:31.631407 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:31.632475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:32.048126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3617b8bcac4227b1295e294eec664a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2d1bc3b35054c44bbe955a9eddc3052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:06:32.063225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-92c0f7e4-7f7e-4e04-b8b3-1ffc532eab16 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 200 len: 1460 microversion: 2.1 time: 0.446269 Jul 21 21:06:32.064727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 583/1162] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:31 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 1460 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:06:32.251625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-ca549173-097c-46ea-93c1-dfc8443a02ba req-47dafdf5-c6a5-420f-b8d6-75f7c0ca1719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1a51f4-55bb-4e9b-9f33-05c4013f32e2", "name": "network-vif-deleted", "tag": "09c78425-8076-4365-905c-544aaead3728"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:32.260070 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-ca549173-097c-46ea-93c1-dfc8443a02ba req-47dafdf5-c6a5-420f-b8d6-75f7c0ca1719 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:32.260513 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-ca549173-097c-46ea-93c1-dfc8443a02ba req-47dafdf5-c6a5-420f-b8d6-75f7c0ca1719 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:32.272924 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-ca549173-097c-46ea-93c1-dfc8443a02ba req-47dafdf5-c6a5-420f-b8d6-75f7c0ca1719 service nova] Creating event network-vif-deleted:09c78425-8076-4365-905c-544aaead3728 for instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 on hv-cinder-85068 Jul 21 21:06:32.278235 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-ca549173-097c-46ea-93c1-dfc8443a02ba req-47dafdf5-c6a5-420f-b8d6-75f7c0ca1719 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031305 Jul 21 21:06:32.278852 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 580/1163] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:06:33.082028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:33.082657 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:33.089477 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:33.089939 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:33.090717 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:33.091200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:33.104553 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] HTTP exception thrown: Instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 could not be found. Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Request method failure captured: Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 HTTP/1.1 Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b1r1hcyiSTWwswaD4oU87V_Ol743LFKzlceCa4YCWBJVV_5Bi6q9FzRaucZCGkXv8NjYTjG5BexJOqymLeRU6ElWcs24VNv-_5U18mhGY9EFKkib1Op0kY-oXuAlN8PEaAcI4saLdNZxZnduAF7jy3zG5Fcb04KPIkbwYYiJQnewD4 Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:06:33.106466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 2b3617b8bcac4227b1295e294eec664a Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 could not be found. Jul 21 21:06:33.108226 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '4c1a51f4-55bb-4e9b-9f33-05c4013f32e2'} Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 could not be found. Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:06:33.109195 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 could not be found. Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 could not be found. Jul 21 21:06:33.110705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.112129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Returning 404 to user: Instance 4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:06:33.112129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b51f2e01-8df3-40e0-8655-6c52328d56c9 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2" status: 404 len: 111 microversion: 2.1 time: 0.030227 Jul 21 21:06:33.112129 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 584/1164] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:33 2022] GET /compute/v2.1/servers/4c1a51f4-55bb-4e9b-9f33-05c4013f32e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:06:33.794611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:33.795194 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:33.801430 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:33.801873 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:33.802631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:33.803061 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:33.817007 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] HTTP exception thrown: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Request method failure captured: Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: DELETE /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d HTTP/1.1 Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b1r1hcyiSTWwswaD4oU87V_Ol743LFKzlceCa4YCWBJVV_5Bi6q9FzRaucZCGkXv8NjYTjG5BexJOqymLeRU6ElWcs24VNv-_5U18mhGY9EFKkib1Op0kY-oXuAlN8PEaAcI4saLdNZxZnduAF7jy3zG5Fcb04KPIkbwYYiJQnewD4 Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:06:33.818631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 2b3617b8bcac4227b1295e294eec664a Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.820273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '528c37e5-c939-4326-bb37-7b63c853560d'} Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:06:33.821314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.822819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.825075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Returning 404 to user: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:06:33.825075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c88f53ae-0123-4c69-98e2-d1dd2de4b6c8 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "DELETE /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 404 len: 111 microversion: 2.1 time: 0.030606 Jul 21 21:06:33.825075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 581/1165] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:06:33 2022] DELETE /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:06:33.829221 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:33.829843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] [instance: 528c37e5-c939-4326-bb37-7b63c853560d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:33.835913 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:33.836368 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:33.837132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:33.837573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:33.850801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] HTTP exception thrown: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Request method failure captured: Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d HTTP/1.1 Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b1r1hcyiSTWwswaD4oU87V_Ol743LFKzlceCa4YCWBJVV_5Bi6q9FzRaucZCGkXv8NjYTjG5BexJOqymLeRU6ElWcs24VNv-_5U18mhGY9EFKkib1Op0kY-oXuAlN8PEaAcI4saLdNZxZnduAF7jy3zG5Fcb04KPIkbwYYiJQnewD4 Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:06:33.852338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f2d1bc3b35054c44bbe955a9eddc3052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: f2d1bc3b35054c44bbe955a9eddc3052 Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-TestVolumeBootPattern-289690432 Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 2b3617b8bcac4227b1295e294eec664a Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-TestVolumeBootPattern-289690432-project Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.853956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '528c37e5-c939-4326-bb37-7b63c853560d'} Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:06:33.854812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. Jul 21 21:06:33.856653 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:33.858009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Returning 404 to user: Instance 528c37e5-c939-4326-bb37-7b63c853560d could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:06:33.858009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f3a493cb-e8cf-4c04-ad52-f47cab8d88a0 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d" status: 404 len: 111 microversion: 2.1 time: 0.028859 Jul 21 21:06:33.858009 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 585/1166] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:06:33 2022] GET /compute/v2.1/servers/528c37e5-c939-4326-bb37-7b63c853560d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 21:06:35.144048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9ea58c6b-217b-45b1-ad6a-830b3c841fd4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] Calling method '.version_select at 0x7f354019aa60>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:35.163331 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9ea58c6b-217b-45b1-ad6a-830b3c841fd4 tempest-TestVolumeBootPattern-289690432 tempest-TestVolumeBootPattern-289690432-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1053486654" status: 202 len: 0 microversion: 2.1 time: 0.023027 Jul 21 21:06:35.163919 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 582/1167] 10.222.0.60 () {58 vars in 1262 bytes} [Thu Jul 21 21:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1053486654 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:06:55.995040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1364094149"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:55.995728 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:55.998378 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=42 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:55.999018 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=94 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:56.004979 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:56.005426 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:56.006183 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:56.006623 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:56.137036 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.network.security_group_api [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Removing security group 30209766-afea-4350-9623-3bc5c35de3b8 from port 5538cf4c-9233-42e2-88c0-e8e5d4986ab9 Jul 21 21:06:56.756273 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-67e1fd1b-c787-4b18-a44c-0b3b3cbf624e tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/action" status: 202 len: 0 microversion: 2.1 time: 0.765459 Jul 21 21:06:56.761900 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:56.762785 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:06:56.767442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-674ad951-7b96-474b-bd17-460147969ff9 req-134a6fd2-5c07-47a8-8dcf-9dbe63a77a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974db758-4954-4768-b496-7733bc3c0f3b", "tag": "5538cf4c-9233-42e2-88c0-e8e5d4986ab9"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:56.773109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 586/1168] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 21:06:55 2022] POST /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:06:56.783775 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-674ad951-7b96-474b-bd17-460147969ff9 req-134a6fd2-5c07-47a8-8dcf-9dbe63a77a0b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:56.784487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-674ad951-7b96-474b-bd17-460147969ff9 req-134a6fd2-5c07-47a8-8dcf-9dbe63a77a0b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:56.807790 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-674ad951-7b96-474b-bd17-460147969ff9 req-134a6fd2-5c07-47a8-8dcf-9dbe63a77a0b service nova] Creating event network-changed:5538cf4c-9233-42e2-88c0-e8e5d4986ab9 for instance 974db758-4954-4768-b496-7733bc3c0f3b on hv-cinder-85068 Jul 21 21:06:56.814597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-674ad951-7b96-474b-bd17-460147969ff9 req-134a6fd2-5c07-47a8-8dcf-9dbe63a77a0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054144 Jul 21 21:06:56.815350 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 583/1169] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:06:57.951549 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:57.952098 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:57.958272 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:57.958720 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:57.959485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:57.959948 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:58.041736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lazy-loading 'services' on Instance uuid 974db758-4954-4768-b496-7733bc3c0f3b {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:06:58.122460 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-49aca001-0975-4cb6-8994-029792198174 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "DELETE /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments/9f6d4b35-05e6-48a9-95e5-520fb61ddff3" status: 202 len: 0 microversion: 2.1 time: 0.175965 Jul 21 21:06:58.124417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 587/1170] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:06:57 2022] DELETE /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments/9f6d4b35-05e6-48a9-95e5-520fb61ddff3 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:06:58.134703 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-add7a6c7-567b-4437-a675-0f025a7d3c15 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:58.135740 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-add7a6c7-567b-4437-a675-0f025a7d3c15 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:58.142600 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-add7a6c7-567b-4437-a675-0f025a7d3c15 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:58.143044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-add7a6c7-567b-4437-a675-0f025a7d3c15 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:58.144092 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-add7a6c7-567b-4437-a675-0f025a7d3c15 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:58.144536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-add7a6c7-567b-4437-a675-0f025a7d3c15 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:58.176233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-add7a6c7-567b-4437-a675-0f025a7d3c15 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046590 Jul 21 21:06:58.176807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 584/1171] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:06:58 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:06:58.831303 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-e3c714e4-e651-4be0-be24-41d1408d3d6e req-72b41c2a-5965-4649-b486-4aafb68b97c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974db758-4954-4768-b496-7733bc3c0f3b", "tag": "5538cf4c-9233-42e2-88c0-e8e5d4986ab9"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:06:58.840578 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-e3c714e4-e651-4be0-be24-41d1408d3d6e req-72b41c2a-5965-4649-b486-4aafb68b97c9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:58.841159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-e3c714e4-e651-4be0-be24-41d1408d3d6e req-72b41c2a-5965-4649-b486-4aafb68b97c9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:58.852364 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-e3c714e4-e651-4be0-be24-41d1408d3d6e req-72b41c2a-5965-4649-b486-4aafb68b97c9 service nova] Creating event network-changed:5538cf4c-9233-42e2-88c0-e8e5d4986ab9 for instance 974db758-4954-4768-b496-7733bc3c0f3b on hv-cinder-85068 Jul 21 21:06:58.858029 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-e3c714e4-e651-4be0-be24-41d1408d3d6e req-72b41c2a-5965-4649-b486-4aafb68b97c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030839 Jul 21 21:06:58.858630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 588/1172] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:06:59.189207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-40547a74-9b1f-4069-a281-6ec411a2889d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:59.190215 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-40547a74-9b1f-4069-a281-6ec411a2889d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:59.196654 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-40547a74-9b1f-4069-a281-6ec411a2889d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:59.197171 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-40547a74-9b1f-4069-a281-6ec411a2889d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:59.198002 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-40547a74-9b1f-4069-a281-6ec411a2889d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:59.198508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-40547a74-9b1f-4069-a281-6ec411a2889d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:59.231113 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-40547a74-9b1f-4069-a281-6ec411a2889d tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045667 Jul 21 21:06:59.231695 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 585/1173] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:06:59 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:06:59.242561 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:06:59.243417 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:06:59.250193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:59.250639 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:59.251402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:06:59.251855 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:06:59.325781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] HTTP exception thrown: Instance 974db758-4954-4768-b496-7733bc3c0f3b is not attached to volume 9f6d4b35-05e6-48a9-95e5-520fb61ddff3 Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Request method failure captured: Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: DELETE /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments/9f6d4b35-05e6-48a9-95e5-520fb61ddff3 HTTP/1.1 Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b8JuoiPMyZr-a0QWMXAuCRlXrbvSQchNQr2AqGLe0eBLOp47A8y3U4S1kTshK89sp60Un0ULBECGcdr0xUJz_p_OxSoVdNpL1WuMZuYefEuYg2nMjYDZgw1wMOKKpIiwu9z4LZusazENi6o2e-plQI0Xamdf1gP0K5e4oGcOVIAiMM Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6a26de2015bb4626ba4093aac7a3d085 Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-TestMinimumBasicScenario-1829084385 Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:06:59.328126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-TestMinimumBasicScenario-1829084385 Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6a26de2015bb4626ba4093aac7a3d085 Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1829084385 Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-TestMinimumBasicScenario-1829084385-project Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 084923b3deae41cd89c3935aed11a566 Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-TestMinimumBasicScenario-1829084385-project Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:06:59.329644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 974db758-4954-4768-b496-7733bc3c0f3b is not attached to volume 9f6d4b35-05e6-48a9-95e5-520fb61ddff3 Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'server_id': '974db758-4954-4768-b496-7733bc3c0f3b', 'id': '9f6d4b35-05e6-48a9-95e5-520fb61ddff3'} Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9f6d4b35-05e6-48a9-95e5-520fb61ddff3. Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:06:59.330449 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974db758-4954-4768-b496-7733bc3c0f3b is not attached to volume 9f6d4b35-05e6-48a9-95e5-520fb61ddff3 Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974db758-4954-4768-b496-7733bc3c0f3b is not attached to volume 9f6d4b35-05e6-48a9-95e5-520fb61ddff3 Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:06:59.331905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Returning 404 to user: Instance 974db758-4954-4768-b496-7733bc3c0f3b is not attached to volume 9f6d4b35-05e6-48a9-95e5-520fb61ddff3 {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:06:59.332978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-951ce6f3-c2b6-4a37-aa98-f271965a5869 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "DELETE /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments/9f6d4b35-05e6-48a9-95e5-520fb61ddff3" status: 404 len: 154 microversion: 2.1 time: 0.091913 Jul 21 21:06:59.332978 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 589/1174] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:06:59 2022] DELETE /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b/os-volume_attachments/9f6d4b35-05e6-48a9-95e5-520fb61ddff3 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:07:00.469480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:00.469999 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:00.476673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:00.477124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:00.477893 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:00.478330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:00.506866 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:07:00.592210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-64966e3e-4727-45bb-8ace-bc0df429d85f tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "DELETE /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 204 len: 0 microversion: 2.1 time: 0.126047 Jul 21 21:07:00.593144 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 586/1175] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:07:00 2022] DELETE /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:07:00.601325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:00.602571 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:00.612096 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:00.612582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:00.613709 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:00.614347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:00.766211 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:00.773950 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-cb8dd399-72ef-4ff4-8a47-535d4d060d8a tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1555 microversion: 2.1 time: 0.176702 Jul 21 21:07:00.774519 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 590/1176] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:00 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:01.792203 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:01.793152 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:01.799280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:01.799730 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:01.800517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:01.800956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:01.930432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:01.938101 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cf5812bf-8402-463b-9f0f-7d26a38634c2 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1555 microversion: 2.1 time: 0.150066 Jul 21 21:07:01.938659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 587/1177] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:01 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:02.954548 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:02.955172 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:02.961837 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:02.962289 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:02.963061 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:02.963501 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:03.094422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084923b3deae41cd89c3935aed11a566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a26de2015bb4626ba4093aac7a3d085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:03.103306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-61b49bd9-100d-4381-886a-26526d45ecf3 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 200 len: 1555 microversion: 2.1 time: 0.152670 Jul 21 21:07:03.104084 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 591/1178] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:02 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:03.363378 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-a9206d97-54fb-4435-81aa-e9540f4a063c req-4d742ba9-aa92-4351-a599-0caf090e2e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974db758-4954-4768-b496-7733bc3c0f3b", "name": "network-vif-deleted", "tag": "5538cf4c-9233-42e2-88c0-e8e5d4986ab9"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:07:03.372806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-a9206d97-54fb-4435-81aa-e9540f4a063c req-4d742ba9-aa92-4351-a599-0caf090e2e11 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:03.373255 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-a9206d97-54fb-4435-81aa-e9540f4a063c req-4d742ba9-aa92-4351-a599-0caf090e2e11 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:03.384275 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-a9206d97-54fb-4435-81aa-e9540f4a063c req-4d742ba9-aa92-4351-a599-0caf090e2e11 service nova] Creating event network-vif-deleted:5538cf4c-9233-42e2-88c0-e8e5d4986ab9 for instance 974db758-4954-4768-b496-7733bc3c0f3b on hv-cinder-85068 Jul 21 21:07:03.389826 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-a9206d97-54fb-4435-81aa-e9540f4a063c req-4d742ba9-aa92-4351-a599-0caf090e2e11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030094 Jul 21 21:07:03.390453 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 588/1179] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:04.125748 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:04.125748 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] [instance: 974db758-4954-4768-b496-7733bc3c0f3b] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:04.133757 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:04.134216 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:04.135000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:04.135443 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:04.150376 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] HTTP exception thrown: Instance 974db758-4954-4768-b496-7733bc3c0f3b could not be found. Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Request method failure captured: Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b HTTP/1.1 Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b8JuoiPMyZr-a0QWMXAuCRlXrbvSQchNQr2AqGLe0eBLOp47A8y3U4S1kTshK89sp60Un0ULBECGcdr0xUJz_p_OxSoVdNpL1WuMZuYefEuYg2nMjYDZgw1wMOKKpIiwu9z4LZusazENi6o2e-plQI0Xamdf1gP0K5e4oGcOVIAiMM Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6a26de2015bb4626ba4093aac7a3d085 Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-TestMinimumBasicScenario-1829084385 Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:07:04.152448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a26de2015bb4626ba4093aac7a3d085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-TestMinimumBasicScenario-1829084385 Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6a26de2015bb4626ba4093aac7a3d085 Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1829084385 Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-TestMinimumBasicScenario-1829084385-project Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 084923b3deae41cd89c3935aed11a566 Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-TestMinimumBasicScenario-1829084385-project Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 974db758-4954-4768-b496-7733bc3c0f3b could not be found. Jul 21 21:07:04.154157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '974db758-4954-4768-b496-7733bc3c0f3b'} Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974db758-4954-4768-b496-7733bc3c0f3b could not be found. Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:07:04.155131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974db758-4954-4768-b496-7733bc3c0f3b could not be found. Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974db758-4954-4768-b496-7733bc3c0f3b could not be found. Jul 21 21:07:04.156483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:07:04.157768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Returning 404 to user: Instance 974db758-4954-4768-b496-7733bc3c0f3b could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:07:04.157768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-977d240a-c09e-473d-b293-408c541b8975 tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b" status: 404 len: 111 microversion: 2.1 time: 0.036698 Jul 21 21:07:04.157768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 592/1180] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:04 2022] GET /compute/v2.1/servers/974db758-4954-4768-b496-7733bc3c0f3b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:07:04.163517 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-f477ba89-bcb7-472b-bb81-c5ce631810ba tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] Calling method '.version_select at 0x7f354032c310>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:04.180757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-f477ba89-bcb7-472b-bb81-c5ce631810ba tempest-TestMinimumBasicScenario-1829084385 tempest-TestMinimumBasicScenario-1829084385-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1745406986" status: 202 len: 0 microversion: 2.1 time: 0.021365 Jul 21 21:07:04.181313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 589/1181] 10.222.0.60 () {58 vars in 1271 bytes} [Thu Jul 21 21:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1745406986 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:07:11.983669 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e9d0a890-6c13-4b99-8a44-c2a24ac56179 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:11.984352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e9d0a890-6c13-4b99-8a44-c2a24ac56179 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:11.990906 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9d0a890-6c13-4b99-8a44-c2a24ac56179 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:11.991347 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9d0a890-6c13-4b99-8a44-c2a24ac56179 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:11.992190 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9d0a890-6c13-4b99-8a44-c2a24ac56179 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:11.992629 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e9d0a890-6c13-4b99-8a44-c2a24ac56179 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:12.019161 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e9d0a890-6c13-4b99-8a44-c2a24ac56179 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/ips" status: 200 len: 148 microversion: 2.1 time: 0.039525 Jul 21 21:07:12.019771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 593/1182] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 21:07:11 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:13.375236 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-c93f753a-6a28-49d9-b7e7-5b2d36da0a19 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:07:13.376469 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-c93f753a-6a28-49d9-b7e7-5b2d36da0a19 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:13.378352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:07:13.383794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c93f753a-6a28-49d9-b7e7-5b2d36da0a19 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:13.384238 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c93f753a-6a28-49d9-b7e7-5b2d36da0a19 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:13.385027 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c93f753a-6a28-49d9-b7e7-5b2d36da0a19 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:13.385425 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-c93f753a-6a28-49d9-b7e7-5b2d36da0a19 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:13.642802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-c93f753a-6a28-49d9-b7e7-5b2d36da0a19 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272884 Jul 21 21:07:13.643640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 590/1183] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:07:13 2022] POST /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:21.132390 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-150ee3c2-565a-4c0d-bc0a-9f3a724f957d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: .version_select at 0x7f354021c9d0>, body: {"keypair": {"name": "tempest-keypair-177537980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxbb43RbJgejeQ2sCWLR7HVpgWzOCGYrih/3QGMFGEt6ABMcodAKebsygDKBRIEOxa20AaIxfipGqzcQMgpfc0ySVaozxDFaNfFA9N+N0osE43AaJNT31mrva9LPYZ8vg=="}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:07:21.146589 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-150ee3c2-565a-4c0d-bc0a-9f3a724f957d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:07:21.150326 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-150ee3c2-565a-4c0d-bc0a-9f3a724f957d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:07:21.175457 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-150ee3c2-565a-4c0d-bc0a-9f3a724f957d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046889 Jul 21 21:07:21.176100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 594/1184] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 21:07:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:22.697891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-320980512", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a056bea-ebfc-41ce-8004-0588675751ae"}], "security_groups": [{"name": "tempest-securitygroup--1679454531"}], "key_name": "tempest-keypair-177537980", "user_data": "}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:07:22.798749 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.network.neutron [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] validate_networks() for [('9a056bea-ebfc-41ce-8004-0588675751ae', None, None, None, None, None)] {{(pid=124646) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:07:23.169608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:07:23.170034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image limits 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:07:23.170514 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:07:23.170929 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image pref 0:0:0 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:07:23.171345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.virt.hardware [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:07:23.180279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:23.180729 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:23.181532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:23.181967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:23.198507 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:07:23.202656 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:07:23.213797 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Going to run 1 instances... {{(pid=124646) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:07:23.216649 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:07:23.264569 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-786df47e-0b26-464d-9276-926d62310609 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571267 Jul 21 21:07:23.265208 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 591/1185] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:07:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:07:23.272425 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:07:23.277761 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-137ca90b-c31d-4e8b-aaa7-7fa0cfba6260 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:23.278377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-137ca90b-c31d-4e8b-aaa7-7fa0cfba6260 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:23.335091 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-137ca90b-c31d-4e8b-aaa7-7fa0cfba6260 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:23.342584 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-137ca90b-c31d-4e8b-aaa7-7fa0cfba6260 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1240 microversion: 2.1 time: 0.071029 Jul 21 21:07:23.343269 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 595/1186] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:23 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:07:24.360791 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:24.361381 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:24.368562 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:24.368994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:24.369747 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:24.370180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:24.434349 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:24.442203 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-156b0908-3aeb-4256-aabc-adeced398bdc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1292 microversion: 2.1 time: 0.085751 Jul 21 21:07:24.442762 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 592/1187] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:24 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:25.458392 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:25.459013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:25.465542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:25.465997 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:25.466805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:25.467248 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:25.601777 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:25.610940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-947c2078-85e6-4daa-84ad-2fe5c44f8a9a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.156345 Jul 21 21:07:25.611595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 596/1188] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:25 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:26.281529 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-bcf039e0-8b90-41de-94c1-0f24e1fad513 req-03d74b99-3869-4387-ad88-0dd20165a890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f896fc-e71f-463e-b416-8f425c5ab33d", "tag": "d5c58d5e-5dad-47ae-849c-a07fc4120ecc"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:07:26.291033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-bcf039e0-8b90-41de-94c1-0f24e1fad513 req-03d74b99-3869-4387-ad88-0dd20165a890 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:26.291476 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-bcf039e0-8b90-41de-94c1-0f24e1fad513 req-03d74b99-3869-4387-ad88-0dd20165a890 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:26.306639 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-bcf039e0-8b90-41de-94c1-0f24e1fad513 req-03d74b99-3869-4387-ad88-0dd20165a890 service nova] Creating event network-changed:d5c58d5e-5dad-47ae-849c-a07fc4120ecc for instance 70f896fc-e71f-463e-b416-8f425c5ab33d on hv-cinder-85068 Jul 21 21:07:26.312470 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-bcf039e0-8b90-41de-94c1-0f24e1fad513 req-03d74b99-3869-4387-ad88-0dd20165a890 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034606 Jul 21 21:07:26.313069 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 593/1189] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:26.629351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:26.629969 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:26.632262 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:07:26.638148 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:26.638609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:26.639410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:26.639860 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:26.774762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:26.783106 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-344f745b-33f2-4c55-807a-1697e5e949fe tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.157629 Jul 21 21:07:26.783624 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 597/1190] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:26 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:27.800715 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:27.801416 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:27.803320 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:07:27.809313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:27.809765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:27.810545 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:27.810967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:27.947850 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:27.955450 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-aae2ba54-6cc3-4aeb-984a-3cd7fcbacbde tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.159473 Jul 21 21:07:27.956064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 594/1191] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:27 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:28.973000 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:28.973631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:28.980630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:28.981135 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:28.981909 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:28.982346 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:29.278235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:29.285739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e67ec830-368e-4d3a-9ffb-329991663805 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.316650 Jul 21 21:07:29.286393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 598/1192] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:28 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:30.302578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:30.303795 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:30.310287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:30.310741 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:30.311515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:30.311978 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:30.503492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:30.510947 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e180caa0-1c9a-4ad6-95f2-cc7fb2c43629 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.212266 Jul 21 21:07:30.512377 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 595/1193] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:30 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:31.529745 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:31.530354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:31.537005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:31.537448 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:31.538205 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:31.538634 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:31.670109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:31.677668 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c258aa4b-9eb6-4538-979a-873400e0219c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.152546 Jul 21 21:07:31.678252 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 599/1194] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:31 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:32.326653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-ca42d5ee-f830-44be-965f-1d0e39333a77 req-3e64850b-4884-4578-81c7-d7de01ab5b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f896fc-e71f-463e-b416-8f425c5ab33d", "name": "network-vif-plugged", "status": "completed", "tag": "d5c58d5e-5dad-47ae-849c-a07fc4120ecc"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:07:32.335247 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-ca42d5ee-f830-44be-965f-1d0e39333a77 req-3e64850b-4884-4578-81c7-d7de01ab5b2e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:32.335695 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-ca42d5ee-f830-44be-965f-1d0e39333a77 req-3e64850b-4884-4578-81c7-d7de01ab5b2e service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:32.347390 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-ca42d5ee-f830-44be-965f-1d0e39333a77 req-3e64850b-4884-4578-81c7-d7de01ab5b2e service nova] Creating event network-vif-plugged:d5c58d5e-5dad-47ae-849c-a07fc4120ecc for instance 70f896fc-e71f-463e-b416-8f425c5ab33d on hv-cinder-85068 Jul 21 21:07:32.352137 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-ca42d5ee-f830-44be-965f-1d0e39333a77 req-3e64850b-4884-4578-81c7-d7de01ab5b2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029752 Jul 21 21:07:32.352726 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 596/1195] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:32.694361 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:32.694981 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:32.701903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:32.702359 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:32.703132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:32.703573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:32.831770 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:32.839609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-15692c85-ca81-45b9-8e2a-ec7948d77302 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.148646 Jul 21 21:07:32.840278 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 600/1196] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:32 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:33.857124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:33.857822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:33.859810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:07:33.860465 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:07:33.866802 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:33.867248 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:33.868044 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:33.868742 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:33.998301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:34.005795 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b52c70ab-aa5c-4f06-b285-5244e3486234 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1366 microversion: 2.1 time: 0.153872 Jul 21 21:07:34.006356 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 597/1197] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:33 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:07:35.022514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:35.023126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:35.025065 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:07:35.030466 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:35.030908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:35.031662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:35.032120 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:35.167139 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:07:35.174906 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b3d7433a-8bb6-4991-98e9-194bd5d9a46f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1555 microversion: 2.1 time: 0.156418 Jul 21 21:07:35.175479 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 601/1198] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:07:35 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:07:35.191389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-dd535f07-6117-4c99-8664-b19506541c7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:07:35.191914 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-dd535f07-6117-4c99-8664-b19506541c7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:07:35.198238 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd535f07-6117-4c99-8664-b19506541c7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:35.199283 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd535f07-6117-4c99-8664-b19506541c7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:35.200060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd535f07-6117-4c99-8664-b19506541c7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:35.200490 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-dd535f07-6117-4c99-8664-b19506541c7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:35.276919 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-dd535f07-6117-4c99-8664-b19506541c7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089061 Jul 21 21:07:35.277549 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 598/1199] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 21:07:35 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:36.463705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-6a962a85-5bd6-40eb-ade5-de675e6160c3 req-26fcfb9e-8f80-4109-b449-3fa36c9503b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f896fc-e71f-463e-b416-8f425c5ab33d", "tag": "d5c58d5e-5dad-47ae-849c-a07fc4120ecc"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:07:36.475199 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-6a962a85-5bd6-40eb-ade5-de675e6160c3 req-26fcfb9e-8f80-4109-b449-3fa36c9503b9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:07:36.475654 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-6a962a85-5bd6-40eb-ade5-de675e6160c3 req-26fcfb9e-8f80-4109-b449-3fa36c9503b9 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:07:36.487035 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-6a962a85-5bd6-40eb-ade5-de675e6160c3 req-26fcfb9e-8f80-4109-b449-3fa36c9503b9 service nova] Creating event network-changed:d5c58d5e-5dad-47ae-849c-a07fc4120ecc for instance 70f896fc-e71f-463e-b416-8f425c5ab33d on hv-cinder-85068 Jul 21 21:07:36.494782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-6a962a85-5bd6-40eb-ade5-de675e6160c3 req-26fcfb9e-8f80-4109-b449-3fa36c9503b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034650 Jul 21 21:07:36.496265 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 602/1200] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:07:42.592428 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:07:42.593053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 21:07:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:08:51.807577 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=9 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:08:51.808358 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:08:51.812615 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-ec152c4c-3a1a-40ae-b457-b351fcdef152 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:51.813104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-ec152c4c-3a1a-40ae-b457-b351fcdef152 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:51.820143 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ec152c4c-3a1a-40ae-b457-b351fcdef152 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:51.820587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ec152c4c-3a1a-40ae-b457-b351fcdef152 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:51.821344 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ec152c4c-3a1a-40ae-b457-b351fcdef152 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:51.821779 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-ec152c4c-3a1a-40ae-b457-b351fcdef152 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:51.846937 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-ec152c4c-3a1a-40ae-b457-b351fcdef152 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d/ips" status: 200 len: 148 microversion: 2.1 time: 0.041187 Jul 21 21:08:51.847501 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 599/1201] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 21:08:51 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:08:51.856109 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=11 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:08:51.856843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=38 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:08:51.861465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:08:51.862598 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:51.869744 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:51.870193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:51.870952 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:51.871386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:51.951552 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Invalid volume: volume 3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8 is already attached to instances: bbfb563f-9476-4097-bdb1-5009aa10a622 Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: POST /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d/os-volume_attachments HTTP/1.1 Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 74 Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:08:51.953386 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {"volumeAttachment": {"volumeId": "3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8"}} Jul 21 21:08:51.955896 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Invalid volume: volume 3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8 is already attached to instances: bbfb563f-9476-4097-bdb1-5009aa10a622 Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'server_id': '70f896fc-e71f-463e-b416-8f425c5ab33d', 'body': {'volumeAttachment': {'volumeId': '3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8'}}} Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8 is already attached to instances: bbfb563f-9476-4097-bdb1-5009aa10a622 Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:51.957162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8 is already attached to instances: bbfb563f-9476-4097-bdb1-5009aa10a622 Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:08:51.958912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8 is already attached to instances: bbfb563f-9476-4097-bdb1-5009aa10a622 Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 400 to user: Invalid volume: volume 3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8 is already attached to instances: bbfb563f-9476-4097-bdb1-5009aa10a622 {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f88753a1-9203-4c57-83a0-79bff8cfe120 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101263 Jul 21 21:08:51.960644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 603/1202] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:08:51 2022] POST /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:08:51.966314 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:51.966814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:51.973973 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:51.974421 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:51.975177 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:51.975611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:52.000651 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:08:52.081273 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-aaf82509-e6a8-4ea0-a268-2e1495484fe1 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 204 len: 0 microversion: 2.1 time: 0.117162 Jul 21 21:08:52.086290 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 600/1203] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:08:51 2022] DELETE /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:08:52.093081 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:52.093811 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:52.100977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:52.101555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:52.102436 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:52.102961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:52.233527 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:08:52.241032 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-db3cc836-f87a-44ab-b9fa-8c56176d146f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1679 microversion: 2.1 time: 0.153076 Jul 21 21:08:52.241590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 604/1204] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:52 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:08:53.259040 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:53.259659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:53.266145 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:53.266590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:53.268142 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:53.268576 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:53.399324 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:08:53.406838 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-17ee5f84-05e9-4905-82ff-9fb2f8f0bab2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1679 microversion: 2.1 time: 0.152118 Jul 21 21:08:53.407400 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 601/1205] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:53 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:08:54.426043 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:54.426662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:54.433404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:54.433852 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:54.434630 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:54.435069 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:54.570318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:08:54.577880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c4764337-2fc0-4c00-9f19-b09369b203a3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 200 len: 1679 microversion: 2.1 time: 0.156858 Jul 21 21:08:54.578459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 605/1206] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:54 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:08:55.058735 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-76a53aa3-b7f5-4d55-bfa7-45dbf4403a16 req-a2f55958-d41a-471e-a3df-a14a542d4b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f896fc-e71f-463e-b416-8f425c5ab33d", "name": "network-vif-deleted", "tag": "d5c58d5e-5dad-47ae-849c-a07fc4120ecc"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:08:55.068856 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-76a53aa3-b7f5-4d55-bfa7-45dbf4403a16 req-a2f55958-d41a-471e-a3df-a14a542d4b18 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:55.069291 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-76a53aa3-b7f5-4d55-bfa7-45dbf4403a16 req-a2f55958-d41a-471e-a3df-a14a542d4b18 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:55.083424 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-76a53aa3-b7f5-4d55-bfa7-45dbf4403a16 req-a2f55958-d41a-471e-a3df-a14a542d4b18 service nova] Creating event network-vif-deleted:d5c58d5e-5dad-47ae-849c-a07fc4120ecc for instance 70f896fc-e71f-463e-b416-8f425c5ab33d on hv-cinder-85068 Jul 21 21:08:55.088679 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-76a53aa3-b7f5-4d55-bfa7-45dbf4403a16 req-a2f55958-d41a-471e-a3df-a14a542d4b18 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Jul 21 21:08:55.089280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 602/1207] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:08:55.595225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:55.596686 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:55.603153 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:55.603752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:55.604680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:55.605245 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:55.623048 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d HTTP/1.1 Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:08:55.624755 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:08:55.626964 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '70f896fc-e71f-463e-b416-8f425c5ab33d'} Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:08:55.627790 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:08:55.629092 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:08:55.630306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:08:55.630306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e86bcfb0-e210-42c3-98f6-d0669ab7a74a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 404 len: 111 microversion: 2.1 time: 0.035910 Jul 21 21:08:55.630306 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 606/1208] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:55 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:08:55.637286 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-08fe6715-327e-45ff-a692-7f982f0a7da5 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '.version_select at 0x7f354032c820>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:55.655099 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-08fe6715-327e-45ff-a692-7f982f0a7da5 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177537980" status: 202 len: 0 microversion: 2.1 time: 0.022049 Jul 21 21:08:55.655822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 603/1209] 10.222.0.60 () {58 vars in 1217 bytes} [Thu Jul 21 21:08:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177537980 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:08:56.339526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:56.340052 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:56.346027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:56.346475 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:56.347240 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:56.347675 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:56.426926 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lazy-loading 'services' on Instance uuid bbfb563f-9476-4097-bdb1-5009aa10a622 {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:08:56.499233 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-aeef0e60-548b-4305-839d-e51dd667718b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments/3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8" status: 202 len: 0 microversion: 2.1 time: 0.163447 Jul 21 21:08:56.499873 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 607/1210] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:08:56 2022] DELETE /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments/3c5d5fa4-3aff-4f7c-a1cb-19abe31e01e8 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:08:56.509456 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0e0531d0-1ae7-4e41-8622-53def5e6773c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:56.510487 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0e0531d0-1ae7-4e41-8622-53def5e6773c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:56.517240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e0531d0-1ae7-4e41-8622-53def5e6773c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:56.517836 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e0531d0-1ae7-4e41-8622-53def5e6773c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:56.518669 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e0531d0-1ae7-4e41-8622-53def5e6773c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:56.519108 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0e0531d0-1ae7-4e41-8622-53def5e6773c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:56.550585 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0e0531d0-1ae7-4e41-8622-53def5e6773c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045390 Jul 21 21:08:56.551066 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 604/1211] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:08:56 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:08:57.563297 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-db0d03fe-852a-4c54-859e-840688c11e51 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:57.564876 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-db0d03fe-852a-4c54-859e-840688c11e51 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:57.571422 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db0d03fe-852a-4c54-859e-840688c11e51 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.571905 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db0d03fe-852a-4c54-859e-840688c11e51 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.572680 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db0d03fe-852a-4c54-859e-840688c11e51 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.573115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-db0d03fe-852a-4c54-859e-840688c11e51 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.604201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-db0d03fe-852a-4c54-859e-840688c11e51 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045279 Jul 21 21:08:57.604767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 608/1212] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:08:57 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:08:57.661533 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:57.662037 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:57.668372 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.668814 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.669573 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.670003 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.695993 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:08:57.773480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b0a75229-799c-410c-89d3-1e8c0fb777cf tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 204 len: 0 microversion: 2.1 time: 0.116225 Jul 21 21:08:57.774345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 605/1213] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:08:57 2022] DELETE /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:08:57.783015 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:57.783631 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:57.789644 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.790094 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.790860 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.791299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.815456 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:08:57.816205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:57.822500 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.822959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.823706 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.824154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.846987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lazy-loading 'flavor' on Instance uuid f17eea1a-2a7e-4d9f-a0a3-198c91480e71 {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:08:57.926539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6157edda-c9cc-4ec3-a3b8-d81f3de7f282 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "POST /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71/action" status: 202 len: 0 microversion: 2.1 time: 0.115370 Jul 21 21:08:57.930462 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 606/1214] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 21:08:57 2022] POST /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 21:08:57.931652 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:08:57.935807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:57.936496 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:57.940027 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-25613258-ceff-49f4-9d8b-a92a908a4f8f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1679 microversion: 2.1 time: 0.160866 Jul 21 21:08:57.940608 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 609/1215] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:57 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:08:57.943250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.943704 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:57.944471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:57.944901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:58.075617 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:08:58.083819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e9c3960d-f2d8-4b43-b0e5-a17700c7bc60 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.151966 Jul 21 21:08:58.084389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 607/1216] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:57 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:08:58.957351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:58.957967 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:58.965178 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:58.965628 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:58.966388 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:58.966826 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:59.097126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:08:59.101650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:08:59.101650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:08:59.105699 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-74dd29b7-3ff8-4e74-aa83-b06d171bc8d3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1679 microversion: 2.1 time: 0.152259 Jul 21 21:08:59.106343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 610/1217] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:58 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:08:59.108048 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:59.108492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:59.109259 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:08:59.109693 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:08:59.242053 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:08:59.249758 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a9307ea0-1ea2-4f16-93ee-ff5b74205d66 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.152413 Jul 21 21:08:59.250346 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 608/1218] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:08:59 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:09:00.122764 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:00.123428 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:00.130514 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:00.130960 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:00.131749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:00.132194 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:00.200085 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:00.215438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-74ee0ce9-7177-410f-838c-33ca7d2068b0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1612 microversion: 2.1 time: 0.096734 Jul 21 21:09:00.216909 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 611/1219] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:00 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1612 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:00.266828 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:00.268122 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:00.274608 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:00.275049 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:00.275833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:00.276301 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:00.745150 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:00.753418 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7d835402-c3e5-42f4-a498-46b2701a0499 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.490505 Jul 21 21:09:00.753987 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 609/1220] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:00 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:00.820337 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-4f05924a-8e72-4739-b5c3-4ac7b59c5b2b req-46969333-938d-4abf-beb8-d4de9add219b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfb563f-9476-4097-bdb1-5009aa10a622", "name": "network-vif-deleted", "tag": "c7c81f7a-fe16-46f7-a7e9-8f5533d58a01"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:00.829019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-4f05924a-8e72-4739-b5c3-4ac7b59c5b2b req-46969333-938d-4abf-beb8-d4de9add219b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:00.829532 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-4f05924a-8e72-4739-b5c3-4ac7b59c5b2b req-46969333-938d-4abf-beb8-d4de9add219b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:00.841895 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-4f05924a-8e72-4739-b5c3-4ac7b59c5b2b req-46969333-938d-4abf-beb8-d4de9add219b service nova] Creating event network-vif-deleted:c7c81f7a-fe16-46f7-a7e9-8f5533d58a01 for instance bbfb563f-9476-4097-bdb1-5009aa10a622 on hv-cinder-85068 Jul 21 21:09:00.847946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-4f05924a-8e72-4739-b5c3-4ac7b59c5b2b req-46969333-938d-4abf-beb8-d4de9add219b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031110 Jul 21 21:09:00.848581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 612/1221] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:09:01.235601 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:01.236690 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:01.243383 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:01.243868 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:01.245010 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:01.245446 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:01.287912 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:01.288523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:01.288801 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lazy-loading 'fault' on Instance uuid bbfb563f-9476-4097-bdb1-5009aa10a622 {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:09:01.335087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:01.344078 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0fced9b2-5c87-4fa3-82cb-6d9d45d3c109 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 200 len: 1331 microversion: 2.1 time: 0.112756 Jul 21 21:09:01.344660 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 610/1222] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:01 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:01.772184 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:01.772892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:01.779389 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:01.779867 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:01.780646 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:01.781086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:01.919276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:01.928010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-303dbdc9-509b-4bb7-9585-878fc97dc095 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.161135 Jul 21 21:09:01.928592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 613/1223] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:01 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:02.364831 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:02.365481 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:02.373169 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:02.373625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:02.374439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:02.374876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:02.391822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 HTTP/1.1 Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:09:02.394000 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:09:02.396366 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'bbfb563f-9476-4097-bdb1-5009aa10a622'} Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:09:02.397281 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:09:02.399523 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:09:02.401471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:09:02.401471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-16384897-3998-41db-aaf8-f61b477a7a09 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 404 len: 111 microversion: 2.1 time: 0.036521 Jul 21 21:09:02.401471 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 611/1224] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:02 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:09:02.406828 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-998c66c3-e39b-447d-9fc7-f168673a4593 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '.version_select at 0x7f3540ca4b80>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:02.426168 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-998c66c3-e39b-447d-9fc7-f168673a4593 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767041971" status: 202 len: 0 microversion: 2.1 time: 0.023148 Jul 21 21:09:02.426742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 614/1225] 10.222.0.60 () {58 vars in 1220 bytes} [Thu Jul 21 21:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767041971 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:09:02.946306 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:02.947480 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:02.955494 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:02.956352 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:02.957180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:02.957629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:02.982827 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:03.118180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:03.126992 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-684d6b18-59c7-4dcb-932f-9fee75e22f34 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.184515 Jul 21 21:09:03.135781 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 612/1226] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:02 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:03.141844 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f17866e9-a69d-4d73-a036-7c6e957ecfc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: .version_select at 0x7f3540b21f70>, body: {"keypair": {"name": "tempest-keypair-1736876605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGae8AVidMxTD6UNfn6jq/Cxm1Dkt/XFqTuN/9+AjAGzojkUCxV+06ysS7nixo2snaK1mjlQl9Vn88Ate5en/dN2KUafQnPyXVTJ7izGjIVb3DY124CzQZ/Vp8aQtMDESg=="}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:03.165192 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-f17866e9-a69d-4d73-a036-7c6e957ecfc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:09:03.169753 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-f17866e9-a69d-4d73-a036-7c6e957ecfc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:09:03.199669 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f17866e9-a69d-4d73-a036-7c6e957ecfc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062343 Jul 21 21:09:03.200740 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 615/1227] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 21:09:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:09:04.144896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:04.145610 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:04.152104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:04.152547 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:04.153300 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:04.153733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:04.359957 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:04.368342 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-237b70e7-c6a6-4600-89c6-3a4085709bbd tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.227259 Jul 21 21:09:04.369007 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 613/1228] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:04 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:04.514300 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1511026640", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a056bea-ebfc-41ce-8004-0588675751ae"}], "security_groups": [{"name": "tempest-securitygroup--1155248572"}], "key_name": "tempest-keypair-1736876605", "user_data": "}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:04.613956 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] validate_networks() for [('9a056bea-ebfc-41ce-8004-0588675751ae', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:09:05.022528 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:09:05.022962 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:09:05.023430 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:09:05.023880 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:09:05.024276 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:09:05.033403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:05.033844 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:05.035921 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:05.036364 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:05.054782 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:09:05.058816 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:09:05.069762 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:09:05.072030 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:09:05.123527 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-fdbd1533-3d18-477f-8288-7c110eead85b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613415 Jul 21 21:09:05.124384 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 616/1229] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:09:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:09:05.134578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-188ba4ff-48b2-4150-936b-8d261c723e0e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:05.135318 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-188ba4ff-48b2-4150-936b-8d261c723e0e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:05.188665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-188ba4ff-48b2-4150-936b-8d261c723e0e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:05.195188 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-188ba4ff-48b2-4150-936b-8d261c723e0e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1242 microversion: 2.1 time: 0.064541 Jul 21 21:09:05.195770 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 614/1230] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:05 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:05.386318 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:05.386940 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:05.393225 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:05.393706 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:05.394591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:05.395035 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:05.540310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:05.547796 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-930b378b-6a1f-421f-998a-b85d4792958f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.165427 Jul 21 21:09:05.548365 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 617/1231] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:05 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:06.211890 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fd1d7746-8b0b-499f-92e3-802191dcdd16 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:06.212505 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fd1d7746-8b0b-499f-92e3-802191dcdd16 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:06.268149 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fd1d7746-8b0b-499f-92e3-802191dcdd16 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:06.274966 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fd1d7746-8b0b-499f-92e3-802191dcdd16 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1242 microversion: 2.1 time: 0.066928 Jul 21 21:09:06.275535 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 615/1232] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:06 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:06.566024 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:06.566564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:06.573100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:06.573565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:06.574309 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:06.574747 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:06.708410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:06.715877 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0cca80e9-5f48-4a60-8a9a-9da7e9547fbf tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.154308 Jul 21 21:09:06.716456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 618/1233] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:06 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:07.291933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e038ac36-57f4-46c1-ab65-c1c6cfc3247d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:07.293077 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e038ac36-57f4-46c1-ab65-c1c6cfc3247d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:07.345066 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-e038ac36-57f4-46c1-ab65-c1c6cfc3247d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:07.352354 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e038ac36-57f4-46c1-ab65-c1c6cfc3247d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1242 microversion: 2.1 time: 0.064373 Jul 21 21:09:07.353115 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 616/1234] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:07 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:07.733124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:07.733737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:07.740843 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:07.741312 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:07.742086 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:07.742527 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:07.876508 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:07.884603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-9f720310-272c-41d4-847f-4a2c999718e0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.155413 Jul 21 21:09:07.885173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 619/1235] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:07 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:08.369460 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-59b21650-1ba6-4dde-9df2-fad0df05683e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:08.370075 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-59b21650-1ba6-4dde-9df2-fad0df05683e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:08.426658 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-59b21650-1ba6-4dde-9df2-fad0df05683e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:08.434246 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-59b21650-1ba6-4dde-9df2-fad0df05683e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1242 microversion: 2.1 time: 0.068928 Jul 21 21:09:08.434807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 617/1236] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:08 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:08.902592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:08.903167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:08.909729 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:08.910150 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:08.910920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:08.911358 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:09.044748 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:09.052236 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-00a9ec8b-231e-4916-9160-dd9043d82a00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.153617 Jul 21 21:09:09.052800 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 620/1237] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:08 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:09.452196 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:09.452969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:09.459566 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:09.460041 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:09.460805 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:09.461231 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:09.552886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:09.560455 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-308fe2cb-a3fe-4a21-8dd8-55f48154ba50 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1246 microversion: 2.1 time: 0.112720 Jul 21 21:09:09.561165 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 618/1238] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:09 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:10.069351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:10.069968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:10.076480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:10.076930 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:10.077692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:10.078132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:10.217051 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:10.225545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ad6a22bc-147e-427a-844f-0b33d52b6bf7 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.160194 Jul 21 21:09:10.226174 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 621/1239] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:10 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:10.582578 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:10.583183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:10.589625 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:10.590068 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:10.590821 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:10.591249 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:10.654219 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:10.662533 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-42e9ff09-89e0-4742-9e78-67fc9e0f2188 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1302 microversion: 2.1 time: 0.084307 Jul 21 21:09:10.663094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 619/1240] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:10 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:11.242995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:11.243545 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:11.250246 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:11.250689 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:11.251445 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:11.251903 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:11.393227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:11.401193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:11.406201 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f0b86bc8-4dfa-4796-95c6-9ac7497a27db tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.167140 Jul 21 21:09:11.406850 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 622/1241] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:11 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:09:11.680162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:11.680791 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:11.687202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:11.687653 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:11.688453 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:11.688888 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:11.770427 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:11.777822 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-6547d0ae-88ef-4b66-ab18-65ef34a8e3a7 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1300 microversion: 2.1 time: 0.101771 Jul 21 21:09:11.778587 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 620/1242] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:11 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:12.424915 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:12.426108 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:12.433124 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.433592 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.434370 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.434812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.582575 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:12.591189 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-a9ba9184-cf74-47a6-ae3a-1b65c452baff tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1569 microversion: 2.1 time: 0.170187 Jul 21 21:09:12.591812 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 623/1243] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:12 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:12.609132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-abe9e1f1-0623-48c7-8492-f95fd8b88c9d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:12.609706 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-abe9e1f1-0623-48c7-8492-f95fd8b88c9d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:12.617045 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-abe9e1f1-0623-48c7-8492-f95fd8b88c9d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.617477 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-abe9e1f1-0623-48c7-8492-f95fd8b88c9d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.618292 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-abe9e1f1-0623-48c7-8492-f95fd8b88c9d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.618932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-abe9e1f1-0623-48c7-8492-f95fd8b88c9d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.744489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-abe9e1f1-0623-48c7-8492-f95fd8b88c9d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "POST /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71/action" status: 202 len: 0 microversion: 2.1 time: 0.138431 Jul 21 21:09:12.745792 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 621/1244] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Jul 21 21:09:12 2022] POST /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:09:12.757256 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:12.758437 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:12.777736 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.778727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.781419 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.783357 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.845804 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-3ab83a36-3888-400d-97ec-1dc8534147c1 req-d8aa39ff-e6c3-4638-8fd0-dd8fe22c1e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fb083e-136a-4a12-b1bb-55ceca55d399", "tag": "ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:12.857525 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3ab83a36-3888-400d-97ec-1dc8534147c1 req-d8aa39ff-e6c3-4638-8fd0-dd8fe22c1e3a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.858112 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-3ab83a36-3888-400d-97ec-1dc8534147c1 req-d8aa39ff-e6c3-4638-8fd0-dd8fe22c1e3a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.887192 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-3ab83a36-3888-400d-97ec-1dc8534147c1 req-d8aa39ff-e6c3-4638-8fd0-dd8fe22c1e3a service nova] Creating event network-changed:ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58 for instance d0fb083e-136a-4a12-b1bb-55ceca55d399 on hv-cinder-85068 Jul 21 21:09:12.900049 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-3ab83a36-3888-400d-97ec-1dc8534147c1 req-d8aa39ff-e6c3-4638-8fd0-dd8fe22c1e3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130166 Jul 21 21:09:12.904623 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 622/1245] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:09:12.910901 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:12.911783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:12.918417 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.918869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:12.919639 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:12.920280 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:13.005889 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:13.017463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-6cc8a23c-2ca3-40c7-b696-e4d5fe4083a6 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1517 microversion: 2.1 time: 0.267150 Jul 21 21:09:13.025200 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 624/1246] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:12 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:13.165039 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:13.172473 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cdf23728-fa10-4b62-a17c-e724ec01a0d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1368 microversion: 2.1 time: 0.266545 Jul 21 21:09:13.173242 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 623/1247] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:12 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:14.042506 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:14.043106 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:14.049548 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:14.050607 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:14.051367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:14.051824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:14.180946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:14.188752 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8bdde1c7-2df3-425f-9c69-e17555b177dc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1517 microversion: 2.1 time: 0.150125 Jul 21 21:09:14.189322 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 625/1248] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:14 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:14.194104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:14.194104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:14.197272 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:14.197710 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:14.198467 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:14.198896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:14.327882 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:14.335652 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b40a15f1-e259-47f5-b750-e2726cef3b0d tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1368 microversion: 2.1 time: 0.149860 Jul 21 21:09:14.336244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 624/1249] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:14 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:09:14.692513 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-226b2c15-1294-4770-a198-b4c37e99de12 req-17ada677-c32f-442c-8aeb-b671f664fa8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17eea1a-2a7e-4d9f-a0a3-198c91480e71", "name": "network-vif-unplugged", "status": "completed", "tag": "6d6d5ecd-8d57-4f55-8259-b5e620742bac"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:14.700595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-226b2c15-1294-4770-a198-b4c37e99de12 req-17ada677-c32f-442c-8aeb-b671f664fa8d service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:14.701082 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-226b2c15-1294-4770-a198-b4c37e99de12 req-17ada677-c32f-442c-8aeb-b671f664fa8d service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:14.712544 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.compute.server_external_events [req-226b2c15-1294-4770-a198-b4c37e99de12 req-17ada677-c32f-442c-8aeb-b671f664fa8d service nova] Unable to find a host for instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71. Dropping event network-vif-unplugged {{(pid=124647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 21:09:14.713423 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-226b2c15-1294-4770-a198-b4c37e99de12 req-17ada677-c32f-442c-8aeb-b671f664fa8d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.087985 Jul 21 21:09:14.714016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 626/1250] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 21 21:09:15.206410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:15.207034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:15.213526 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:15.213988 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:15.214716 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:15.215148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:15.352404 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:15.353016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:15.354672 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:15.355063 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:15.356394 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=10 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:15.362573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:15.362765 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-a2a4536c-b513-47de-971a-4fabb78f979d tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1517 microversion: 2.1 time: 0.160189 Jul 21 21:09:15.363019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:15.363160 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 625/1251] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:15 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:15.363809 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:15.364244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:15.499255 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:15.507452 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c79765d7-3f55-4efe-9b12-6e150bfef6dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1368 microversion: 2.1 time: 0.158841 Jul 21 21:09:15.508055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 627/1252] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:15 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:09:16.380524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:16.381202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:16.387665 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:16.388132 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:16.388891 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:16.389317 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:16.527535 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:16.531647 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:16.532316 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:16.535601 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-96cce772-777c-4909-b594-4ae5c0beb898 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1519 microversion: 2.1 time: 0.159581 Jul 21 21:09:16.536210 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 626/1253] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:16 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:16.539107 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:16.539769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:16.541078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:16.541193 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:16.674443 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:16.682788 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-54c1198c-2e0f-42ef-9390-4b63d3e827bd tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1368 microversion: 2.1 time: 0.161642 Jul 21 21:09:16.683453 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 628/1254] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:16 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:09:17.553894 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:17.555190 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:17.561946 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:17.562395 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:17.563176 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:17.563597 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:17.699119 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:17.700285 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:17.700970 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:17.708126 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:17.708593 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-002c84f4-76ff-4b6d-be80-ec7dbb6f8357 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.158574 Jul 21 21:09:17.708704 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:17.709094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 627/1255] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:17 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:17.709523 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:17.709943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:17.842695 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:17.850769 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ae36e001-f2ad-4525-bf3c-fd4d2fcd3062 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1368 microversion: 2.1 time: 0.154256 Jul 21 21:09:17.851342 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 629/1256] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:17 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:09:18.707333 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-065f8d4d-ab2a-4ae7-939d-14fd9f019671 req-0edf9a8c-38b5-46f3-a793-97807d2a73c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fb083e-136a-4a12-b1bb-55ceca55d399", "name": "network-vif-plugged", "status": "completed", "tag": "ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:18.710862 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=8 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:18.719389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-065f8d4d-ab2a-4ae7-939d-14fd9f019671 req-0edf9a8c-38b5-46f3-a793-97807d2a73c2 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:18.719389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-065f8d4d-ab2a-4ae7-939d-14fd9f019671 req-0edf9a8c-38b5-46f3-a793-97807d2a73c2 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:18.726332 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:18.726951 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:18.731162 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-065f8d4d-ab2a-4ae7-939d-14fd9f019671 req-0edf9a8c-38b5-46f3-a793-97807d2a73c2 service nova] Creating event network-vif-plugged:ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58 for instance d0fb083e-136a-4a12-b1bb-55ceca55d399 on hv-cinder-85068 Jul 21 21:09:18.733679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:18.734137 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:18.734951 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:18.735465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:18.736579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-065f8d4d-ab2a-4ae7-939d-14fd9f019671 req-0edf9a8c-38b5-46f3-a793-97807d2a73c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033501 Jul 21 21:09:18.737393 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 628/1257] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:09:18.869423 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:18.870387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:18.873437 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:18.880813 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:18.881327 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:18.882553 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:18.883126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:18.885995 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0bae8717-cd19-4079-851c-daf0d634fde9 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.164186 Jul 21 21:09:18.886817 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 630/1258] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:18 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:19.075707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:19.083140 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-97b31b24-c593-4dd2-b8fa-6c570a3f71f9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1368 microversion: 2.1 time: 0.218396 Jul 21 21:09:19.083730 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 629/1259] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:18 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:09:19.903076 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:19.903692 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:19.911233 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:19.911681 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:19.912471 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:19.912908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:20.043403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:20.051673 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-42832718-de03-4117-a921-5663fbf7e167 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.152441 Jul 21 21:09:20.052257 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 631/1260] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:19 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:20.099787 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:20.100410 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:20.106767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:20.107214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:20.108006 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:20.108442 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:20.236313 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:20.244638 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-483d116c-7709-4604-b087-e63cc30fa189 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1368 microversion: 2.1 time: 0.148485 Jul 21 21:09:20.245205 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 630/1261] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:20 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:21.068917 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:21.069537 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:21.076016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:21.076469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:21.077231 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:21.077679 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:21.208931 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:21.216414 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-eef4e2f4-77da-4084-88c0-aaf3ad5dc107 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.152447 Jul 21 21:09:21.216982 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 632/1262] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:21 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:21.261206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:21.261810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:21.268294 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:21.268738 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:21.269493 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:21.270344 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:21.397389 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:21.404851 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-de81a977-6e8e-41cb-a6e6-3353f70dc67e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1557 microversion: 2.1 time: 0.147433 Jul 21 21:09:21.405409 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 631/1263] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:21 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:21.421739 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-14e68fdd-e646-4fb4-a498-db386fad198f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:21.422334 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-14e68fdd-e646-4fb4-a498-db386fad198f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:21.428564 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14e68fdd-e646-4fb4-a498-db386fad198f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:21.429019 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14e68fdd-e646-4fb4-a498-db386fad198f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:21.429786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14e68fdd-e646-4fb4-a498-db386fad198f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:21.430228 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-14e68fdd-e646-4fb4-a498-db386fad198f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:21.507920 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-14e68fdd-e646-4fb4-a498-db386fad198f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089985 Jul 21 21:09:21.508528 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 633/1264] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 21:09:21 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:09:22.234364 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:22.234879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:22.236847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:22.243733 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:22.244520 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:22.245298 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:22.245732 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:22.644033 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:22.653640 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4ad03fa3-1d23-4c80-afc8-08fcaecb8ae8 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.423237 Jul 21 21:09:22.654719 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 632/1265] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:22 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:22.689310 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-a482d8c8-2067-486c-b8c4-ce89e7056977 req-9d4df3be-8ce0-4f7d-ba7c-8442105e199b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fb083e-136a-4a12-b1bb-55ceca55d399", "tag": "ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:22.692965 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:22.699028 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-a482d8c8-2067-486c-b8c4-ce89e7056977 req-9d4df3be-8ce0-4f7d-ba7c-8442105e199b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:22.699560 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-a482d8c8-2067-486c-b8c4-ce89e7056977 req-9d4df3be-8ce0-4f7d-ba7c-8442105e199b service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:22.714975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-a482d8c8-2067-486c-b8c4-ce89e7056977 req-9d4df3be-8ce0-4f7d-ba7c-8442105e199b service nova] Creating event network-changed:ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58 for instance d0fb083e-136a-4a12-b1bb-55ceca55d399 on hv-cinder-85068 Jul 21 21:09:22.720429 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-a482d8c8-2067-486c-b8c4-ce89e7056977 req-9d4df3be-8ce0-4f7d-ba7c-8442105e199b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035199 Jul 21 21:09:22.721169 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 634/1266] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:09:23.671540 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:23.672180 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:23.680240 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:23.680725 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:23.681545 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:23.681992 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:23.703223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:09:23.820974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:23.829058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cbc8999a-7b3a-4b2c-a4d1-4a4f91536905 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.161396 Jul 21 21:09:23.829637 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 633/1267] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:23 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:24.847622 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:24.849055 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:24.855108 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:24.855553 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:24.856327 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:24.856765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:24.990250 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:24.998062 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2f22eed1-e44d-449b-aa15-bfe902720afc tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.155450 Jul 21 21:09:24.998636 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 635/1268] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:24 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:26.016159 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:26.016714 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:26.023910 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:26.024337 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:26.025154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:26.025590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:26.164064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:26.171611 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fcbaa864-5a85-4bbe-8e0c-cc9e4b20b068 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.159657 Jul 21 21:09:26.172249 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 634/1269] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:26 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:26.731173 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-8131ccd5-628e-4e2f-a96f-49c8098b82f2 req-6363016b-f5d2-45d6-b72a-a9c78a74cd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17eea1a-2a7e-4d9f-a0a3-198c91480e71", "name": "network-vif-plugged", "status": "completed", "tag": "6d6d5ecd-8d57-4f55-8259-b5e620742bac"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:09:26.740431 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-8131ccd5-628e-4e2f-a96f-49c8098b82f2 req-6363016b-f5d2-45d6-b72a-a9c78a74cd2c service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:26.740871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-8131ccd5-628e-4e2f-a96f-49c8098b82f2 req-6363016b-f5d2-45d6-b72a-a9c78a74cd2c service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:26.752402 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-8131ccd5-628e-4e2f-a96f-49c8098b82f2 req-6363016b-f5d2-45d6-b72a-a9c78a74cd2c service nova] Creating event network-vif-plugged:6d6d5ecd-8d57-4f55-8259-b5e620742bac for instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 on hv-cinder-85068 Jul 21 21:09:26.757807 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-8131ccd5-628e-4e2f-a96f-49c8098b82f2 req-6363016b-f5d2-45d6-b72a-a9c78a74cd2c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030341 Jul 21 21:09:26.758399 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 636/1270] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:09:27.189694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:27.190237 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:27.197810 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:27.198257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:27.199025 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:27.199463 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:27.332039 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:27.339819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b4d4971a-4b0a-4095-b362-46653a6ddf00 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.154114 Jul 21 21:09:27.340387 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 635/1271] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:27 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:28.357738 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:28.358437 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:28.365159 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:28.365609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:28.366367 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:28.366806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:28.498778 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:28.507020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-dbb7d1e1-b246-4e73-80c6-030f1d17f227 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1575 microversion: 2.1 time: 0.154027 Jul 21 21:09:28.507604 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 637/1272] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:28 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:09:29.524179 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:09:29.524789 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:09:29.531424 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:29.531917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:29.532685 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:09:29.533126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:09:29.666403 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:09:29.674001 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8a7df501-85f6-4c3a-9752-ae4f2e6f865a tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1562 microversion: 2.1 time: 0.153650 Jul 21 21:09:29.674575 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 636/1273] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:09:29 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:10:38.840183 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=7 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:10:38.840943 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=76 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:10:38.963066 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d8c3b6d9-f48a-4ff2-a918-ac4e03842dc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:38.963633 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d8c3b6d9-f48a-4ff2-a918-ac4e03842dc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:38.969776 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8c3b6d9-f48a-4ff2-a918-ac4e03842dc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:38.970220 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8c3b6d9-f48a-4ff2-a918-ac4e03842dc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:38.970977 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8c3b6d9-f48a-4ff2-a918-ac4e03842dc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:38.971409 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d8c3b6d9-f48a-4ff2-a918-ac4e03842dc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:38.995406 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d8c3b6d9-f48a-4ff2-a918-ac4e03842dc0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/ips" status: 200 len: 149 microversion: 2.1 time: 0.157242 Jul 21 21:10:38.995996 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 638/1274] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 21:10:38 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/ips => generated 149 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:10:40.303183 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=9 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:10:40.303959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=20 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:10:40.308055 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-fda43497-5312-40fa-8f7a-a39d2f4277dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:10:40.309124 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-fda43497-5312-40fa-8f7a-a39d2f4277dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:40.315933 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fda43497-5312-40fa-8f7a-a39d2f4277dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:40.316385 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fda43497-5312-40fa-8f7a-a39d2f4277dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:40.317148 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fda43497-5312-40fa-8f7a-a39d2f4277dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:40.317586 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-fda43497-5312-40fa-8f7a-a39d2f4277dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:40.568676 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-fda43497-5312-40fa-8f7a-a39d2f4277dc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266971 Jul 21 21:10:40.574111 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 637/1275] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:10:40 2022] POST /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:10:48.051609 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f"}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:10:48.052763 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:48.060289 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:48.060742 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:48.061510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:48.061946 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:48.139723 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Invalid volume: volume 0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f is already attached to instances: d0fb083e-136a-4a12-b1bb-55ceca55d399 Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: POST /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments HTTP/1.1 Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 74 Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:10:48.141456 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {"volumeAttachment": {"volumeId": "0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f"}} Jul 21 21:10:48.143243 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Invalid volume: volume 0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f is already attached to instances: d0fb083e-136a-4a12-b1bb-55ceca55d399 Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'server_id': 'd0fb083e-136a-4a12-b1bb-55ceca55d399', 'body': {'volumeAttachment': {'volumeId': '0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f'}}} Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f is already attached to instances: d0fb083e-136a-4a12-b1bb-55ceca55d399 Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:10:48.144227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f is already attached to instances: d0fb083e-136a-4a12-b1bb-55ceca55d399 Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:10:48.145878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f is already attached to instances: d0fb083e-136a-4a12-b1bb-55ceca55d399 Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 400 to user: Invalid volume: volume 0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f is already attached to instances: d0fb083e-136a-4a12-b1bb-55ceca55d399 {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0f4b9de3-1faf-4325-adde-685e75c44734 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095250 Jul 21 21:10:48.147640 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 639/1276] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:10:48 2022] POST /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 21:10:48.205492 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:48.206074 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:48.215248 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:48.215759 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:48.216524 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:48.216968 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:48.303510 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.objects.instance [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lazy-loading 'services' on Instance uuid d0fb083e-136a-4a12-b1bb-55ceca55d399 {{(pid=124646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:10:48.379291 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-4678d282-7c30-4cc0-8759-8fb7db63ad62 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments/0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f" status: 202 len: 0 microversion: 2.1 time: 0.178315 Jul 21 21:10:48.379913 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 638/1277] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:10:48 2022] DELETE /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments/0f7a4de2-9f9c-4231-8c35-7dbaf9a9448f => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:10:48.388424 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f579b22f-97ee-40f6-9ad1-c980af4f6076 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:48.389351 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f579b22f-97ee-40f6-9ad1-c980af4f6076 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:48.395480 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f579b22f-97ee-40f6-9ad1-c980af4f6076 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:48.395735 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f579b22f-97ee-40f6-9ad1-c980af4f6076 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:48.396507 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f579b22f-97ee-40f6-9ad1-c980af4f6076 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:48.396941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f579b22f-97ee-40f6-9ad1-c980af4f6076 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:48.428555 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f579b22f-97ee-40f6-9ad1-c980af4f6076 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Jul 21 21:10:48.429423 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 640/1278] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:10:48 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:10:49.442534 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-af96e073-9fa4-4091-a0ea-3c47d513afeb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:49.443604 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-af96e073-9fa4-4091-a0ea-3c47d513afeb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:49.450498 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-af96e073-9fa4-4091-a0ea-3c47d513afeb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:49.450941 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-af96e073-9fa4-4091-a0ea-3c47d513afeb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:49.451701 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-af96e073-9fa4-4091-a0ea-3c47d513afeb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:49.452154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-af96e073-9fa4-4091-a0ea-3c47d513afeb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:49.480299 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-af96e073-9fa4-4091-a0ea-3c47d513afeb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042449 Jul 21 21:10:49.480781 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 639/1279] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:10:49 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:10:49.537908 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:49.538426 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:49.545818 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:49.546270 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:49.547038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:49.547478 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:49.572989 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Going to try to terminate instance {{(pid=124647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:10:49.650893 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-2b634a74-31e2-4f11-b229-91a1727ce83e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 204 len: 0 microversion: 2.1 time: 0.116554 Jul 21 21:10:49.651486 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 641/1280] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:10:49 2022] DELETE /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:10:49.659588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:49.660316 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:49.666473 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:49.666917 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:49.667677 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:49.668139 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:49.802126 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:10:49.809626 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9d883b68-f47c-4d5f-9482-ad4384e52367 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1682 microversion: 2.1 time: 0.153875 Jul 21 21:10:49.810185 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 640/1281] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:49 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:10:50.826941 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:50.827638 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:50.834163 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:50.834603 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:50.835354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:50.835838 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:50.967101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:10:50.974542 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-b9b32054-7ef6-42a3-8740-24ca208c7837 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1682 microversion: 2.1 time: 0.151813 Jul 21 21:10:50.975142 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 642/1282] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:50 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:10:51.992250 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:51.992806 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:52.000206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:52.000659 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:52.001433 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:52.001876 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:52.200986 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:10:52.208796 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-036e2361-d821-4109-9965-476c2fc435c8 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 200 len: 1682 microversion: 2.1 time: 0.220573 Jul 21 21:10:52.209691 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 641/1283] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:51 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:10:52.590325 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-9123cb66-b434-4888-8b9b-349becded4e2 req-6b2ddfcc-9f19-4204-a582-95df3f731745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fb083e-136a-4a12-b1bb-55ceca55d399", "name": "network-vif-deleted", "tag": "ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:10:52.601106 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-9123cb66-b434-4888-8b9b-349becded4e2 req-6b2ddfcc-9f19-4204-a582-95df3f731745 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:52.601767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-9123cb66-b434-4888-8b9b-349becded4e2 req-6b2ddfcc-9f19-4204-a582-95df3f731745 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:52.614510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-9123cb66-b434-4888-8b9b-349becded4e2 req-6b2ddfcc-9f19-4204-a582-95df3f731745 service nova] Creating event network-vif-deleted:ce4e8e63-1cae-4fbf-b4e8-90a57c4cef58 for instance d0fb083e-136a-4a12-b1bb-55ceca55d399 on hv-cinder-85068 Jul 21 21:10:52.621095 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-9123cb66-b434-4888-8b9b-349becded4e2 req-6b2ddfcc-9f19-4204-a582-95df3f731745 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034461 Jul 21 21:10:52.621705 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 643/1284] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:10:53.226506 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:53.227105 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:53.235271 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:53.235767 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:53.236522 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:53.236959 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:53.251439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 HTTP/1.1 Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:10:53.253154 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:10:53.254911 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'd0fb083e-136a-4a12-b1bb-55ceca55d399'} Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:10:53.255952 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:10:53.257629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:10:53.259214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:10:53.259214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-1b72d406-5d64-4c27-9753-fc3b9771195a tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 404 len: 111 microversion: 2.1 time: 0.031968 Jul 21 21:10:53.259214 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 642/1285] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:53 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:10:53.265023 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f17f90af-3bbb-4af0-99f7-15814b591a75 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '.version_select at 0x7f3540165430>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:53.284338 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f17f90af-3bbb-4af0-99f7-15814b591a75 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736876605" status: 202 len: 0 microversion: 2.1 time: 0.023641 Jul 21 21:10:53.285151 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 644/1286] 10.222.0.60 () {58 vars in 1220 bytes} [Thu Jul 21 21:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1736876605 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:10:53.902269 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-28e6013c-771f-43b8-a4ec-df7e20803310 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: .version_select at 0x7f354492b1f0>, body: {"keypair": {"name": "tempest-keypair-1784773872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSBWW8de2RPgKjEqg0HHaEc5nnqjis6grUOWCrZCqhSAyITz5SeIOLrNG/mxD7/ZOUPJfs3Zm9je8LQBkp/ifjsxD/5f2kdfvynTH2QEipIGoVT/XaS74/iPQOPBjavhQ=="}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:10:53.916837 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-28e6013c-771f-43b8-a4ec-df7e20803310 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:10:53.922452 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.quota [None req-28e6013c-771f-43b8-a4ec-df7e20803310 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'key_pairs'} {{(pid=124646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:10:53.948256 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-28e6013c-771f-43b8-a4ec-df7e20803310 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050142 Jul 21 21:10:53.948847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 643/1287] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Jul 21 21:10:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:10:55.146892 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1816968707", "imageRef": "43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a056bea-ebfc-41ce-8004-0588675751ae"}], "security_groups": [{"name": "tempest-securitygroup--1879894710"}], "key_name": "tempest-keypair-1784773872", "user_data": "}} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:10:55.249801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.network.neutron [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] validate_networks() for [('9a056bea-ebfc-41ce-8004-0588675751ae', None, None, None, None, None)] {{(pid=124647) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:10:55.615550 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:10:55.616016 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image limits 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:10:55.616497 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Flavor pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:10:55.616912 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Image pref 0:0:0 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:10:55.617333 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.virt.hardware [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:10:55.626901 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:55.627354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:55.628186 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:55.628629 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:55.645435 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:10:55.649405 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.quota [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Getting quotas for user 5272710cad204a49a52116becbce6bc1 and project 6549bea44b794d03bab57a0c2a001992. Resources: {'instances', 'ram', 'cores'} {{(pid=124647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:10:55.660393 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Going to run 1 instances... {{(pid=124647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:10:55.662724 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='43aa55f8-ddf3-403a-9ef9-5e80f2b2e6ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:10:55.709052 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f494283c-4ee7-4bfd-b1f9-22e72e7816bc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567280 Jul 21 21:10:55.709693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 645/1288] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Jul 21 21:10:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 21:10:55.720605 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-baf3a274-3527-4600-8066-4c1ae643c16c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:55.721219 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-baf3a274-3527-4600-8066-4c1ae643c16c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:55.779388 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-baf3a274-3527-4600-8066-4c1ae643c16c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:10:55.786058 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-baf3a274-3527-4600-8066-4c1ae643c16c tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1242 microversion: 2.1 time: 0.069704 Jul 21 21:10:55.787005 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 644/1289] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:55 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:10:56.804410 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:56.805046 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:56.812565 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:56.813020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:56.813836 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:56.814278 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:56.885576 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:10:56.893902 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e1ff4fe8-a3eb-481d-b76d-18027d081286 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1300 microversion: 2.1 time: 0.093997 Jul 21 21:10:56.894570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 646/1290] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:56 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:10:57.911998 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:57.912606 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:57.919207 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:57.919650 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:57.920438 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:57.920872 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:58.128783 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:10:58.136833 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9af157ce-41ba-473c-a0d5-6511372fca39 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1368 microversion: 2.1 time: 0.228695 Jul 21 21:10:58.146475 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 645/1291] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:57 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:10:58.199204 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-503ebe3d-ac2c-4d24-a9bf-13f40bac5a80 req-2d7bc3a8-f0f4-4e2c-ab7a-6641d0929b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae70bb02-09e6-4147-a65b-9cda68d6587a", "tag": "735f011c-8535-4cce-af4f-e8eba3d772fc"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:10:58.210217 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-503ebe3d-ac2c-4d24-a9bf-13f40bac5a80 req-2d7bc3a8-f0f4-4e2c-ab7a-6641d0929b81 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:58.215167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-503ebe3d-ac2c-4d24-a9bf-13f40bac5a80 req-2d7bc3a8-f0f4-4e2c-ab7a-6641d0929b81 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:58.229599 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-503ebe3d-ac2c-4d24-a9bf-13f40bac5a80 req-2d7bc3a8-f0f4-4e2c-ab7a-6641d0929b81 service nova] Creating event network-changed:735f011c-8535-4cce-af4f-e8eba3d772fc for instance ae70bb02-09e6-4147-a65b-9cda68d6587a on hv-cinder-85068 Jul 21 21:10:58.236216 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-503ebe3d-ac2c-4d24-a9bf-13f40bac5a80 req-2d7bc3a8-f0f4-4e2c-ab7a-6641d0929b81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041452 Jul 21 21:10:58.237227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 647/1292] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:10:59.155307 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:10:59.155969 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:10:59.162536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:59.162983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:59.163780 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:10:59.164223 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:10:59.294505 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:10:59.302089 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-57a696b1-01f2-4657-b6d3-08a699501600 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1368 microversion: 2.1 time: 0.151322 Jul 21 21:10:59.302667 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 646/1293] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:10:59 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:00.320296 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:00.320998 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:00.327391 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:00.327866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:00.328636 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:00.329078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:00.457527 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:00.465167 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-382b2ad3-3116-4979-b096-2b2b1c0167a0 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1368 microversion: 2.1 time: 0.149678 Jul 21 21:11:00.465749 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 648/1294] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:00 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:01.482375 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:01.482964 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:01.489503 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:01.489954 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:01.490764 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:01.491206 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:01.629571 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:01.638087 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-0007d22f-e638-4630-82a4-df4e7a61143b tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1368 microversion: 2.1 time: 0.159718 Jul 21 21:11:01.638657 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 647/1295] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:01 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:02.654793 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:02.655369 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:02.662215 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:02.663038 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:02.663836 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:02.664268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:02.820798 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:02.829986 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bda7ea79-0798-423a-945f-2a2d32c3eccc tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1368 microversion: 2.1 time: 0.179143 Jul 21 21:11:02.830563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 649/1296] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:02 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:03.228694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-69226963-0930-49f0-8796-a039ee69b07b req-46ad8afe-cad4-4b8b-95d7-d29e79a79152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae70bb02-09e6-4147-a65b-9cda68d6587a", "name": "network-vif-plugged", "status": "completed", "tag": "735f011c-8535-4cce-af4f-e8eba3d772fc"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:11:03.237432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-69226963-0930-49f0-8796-a039ee69b07b req-46ad8afe-cad4-4b8b-95d7-d29e79a79152 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:03.237869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-69226963-0930-49f0-8796-a039ee69b07b req-46ad8afe-cad4-4b8b-95d7-d29e79a79152 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:03.249956 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-69226963-0930-49f0-8796-a039ee69b07b req-46ad8afe-cad4-4b8b-95d7-d29e79a79152 service nova] Creating event network-vif-plugged:735f011c-8535-4cce-af4f-e8eba3d772fc for instance ae70bb02-09e6-4147-a65b-9cda68d6587a on hv-cinder-85068 Jul 21 21:11:03.254774 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-69226963-0930-49f0-8796-a039ee69b07b req-46ad8afe-cad4-4b8b-95d7-d29e79a79152 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030498 Jul 21 21:11:03.255365 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 648/1297] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:11:03.848519 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:03.849132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:03.855881 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:03.856328 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:03.857088 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:03.857526 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:03.991131 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:03.999585 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-f62da13d-dbb1-4624-89fe-504191a84383 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1368 microversion: 2.1 time: 0.154890 Jul 21 21:11:04.000180 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 650/1298] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:03 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:05.017515 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:05.018215 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:05.024431 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:05.025666 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:05.026432 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:05.026874 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:05.158932 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:05.166629 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-3757434f-7c67-4219-a9a8-10995ee11c21 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1368 microversion: 2.1 time: 0.153830 Jul 21 21:11:05.167200 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 649/1299] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:05 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:06.184040 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:06.184685 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:06.186696 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=2 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:11:06.187352 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell0:SELECT=6 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:11:06.193010 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:06.193463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:06.194227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:06.194667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:06.326235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:06.333645 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-82792d0a-d01f-48eb-a0b7-81f3cf081669 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1557 microversion: 2.1 time: 0.154171 Jul 21 21:11:06.334214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 651/1300] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:06 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:06.351244 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-e2cdd189-9cfd-4bef-acd6-f308394fa4fb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:06.351807 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-e2cdd189-9cfd-4bef-acd6-f308394fa4fb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:06.354329 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell0:SELECT=6 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:11:06.360028 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2cdd189-9cfd-4bef-acd6-f308394fa4fb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:06.360482 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2cdd189-9cfd-4bef-acd6-f308394fa4fb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:06.361253 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2cdd189-9cfd-4bef-acd6-f308394fa4fb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:06.361694 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-e2cdd189-9cfd-4bef-acd6-f308394fa4fb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:06.443202 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-e2cdd189-9cfd-4bef-acd6-f308394fa4fb tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095739 Jul 21 21:11:06.443829 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 650/1301] 10.222.0.60 () {58 vars in 1274 bytes} [Thu Jul 21 21:11:06 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:11:07.360465 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-22d6e884-c855-4c9a-844a-c7b7620dc1bf req-bae43f14-14de-442e-a5d9-c909aa0b574a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae70bb02-09e6-4147-a65b-9cda68d6587a", "tag": "735f011c-8535-4cce-af4f-e8eba3d772fc"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:11:07.369132 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-22d6e884-c855-4c9a-844a-c7b7620dc1bf req-bae43f14-14de-442e-a5d9-c909aa0b574a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:07.369577 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-22d6e884-c855-4c9a-844a-c7b7620dc1bf req-bae43f14-14de-442e-a5d9-c909aa0b574a service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:07.381751 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-22d6e884-c855-4c9a-844a-c7b7620dc1bf req-bae43f14-14de-442e-a5d9-c909aa0b574a service nova] Creating event network-changed:735f011c-8535-4cce-af4f-e8eba3d772fc for instance ae70bb02-09e6-4147-a65b-9cda68d6587a on hv-cinder-85068 Jul 21 21:11:07.388339 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-22d6e884-c855-4c9a-844a-c7b7620dc1bf req-bae43f14-14de-442e-a5d9-c909aa0b574a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031477 Jul 21 21:11:07.389563 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 652/1302] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:11:14.069353 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:14.069926 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:14.071348 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-a5b0839d-ecc9-4db3-b824-69920e3c8155 req-ef009d65-6c92-40fb-9f7e-d1b83f380530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17eea1a-2a7e-4d9f-a0a3-198c91480e71", "tag": "6d6d5ecd-8d57-4f55-8259-b5e620742bac"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:11:14.073364 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:11:14.077673 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:14.078123 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:14.078581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:11:14.079135 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:14.079345 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:14.081005 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-a5b0839d-ecc9-4db3-b824-69920e3c8155 req-ef009d65-6c92-40fb-9f7e-d1b83f380530 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:14.081446 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-a5b0839d-ecc9-4db3-b824-69920e3c8155 req-ef009d65-6c92-40fb-9f7e-d1b83f380530 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:14.084875 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:11:14.087955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:11:14.097020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-a5b0839d-ecc9-4db3-b824-69920e3c8155 req-ef009d65-6c92-40fb-9f7e-d1b83f380530 service nova] Creating event network-changed:6d6d5ecd-8d57-4f55-8259-b5e620742bac for instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 on hv-cinder-85068 Jul 21 21:11:14.104089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-a5b0839d-ecc9-4db3-b824-69920e3c8155 req-ef009d65-6c92-40fb-9f7e-d1b83f380530 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035848 Jul 21 21:11:14.104853 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 653/1303] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:11:14.110794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:11:14.195131 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2466bc2f-9539-4e4b-a901-83a555eff93f tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 204 len: 0 microversion: 2.1 time: 0.130318 Jul 21 21:11:14.195894 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 651/1304] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:11:14 2022] DELETE /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:11:14.205657 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:14.206354 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:14.215222 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:14.215774 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:14.216541 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:14.217166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:14.363343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:14.372029 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e7b901bf-a6f4-4af0-ab1b-321c11014b97 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.170738 Jul 21 21:11:14.372588 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 654/1305] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:14 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:15.390614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:15.391341 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:15.397755 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:15.398201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:15.398967 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:15.399434 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:15.559994 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:15.567819 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-d4931289-eee0-4ad9-b1c9-4fbca7f6979b tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1568 microversion: 2.1 time: 0.181328 Jul 21 21:11:15.568607 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 652/1306] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:15 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:16.506768 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [req-3ef6c57e-b904-4bdb-8cc4-148b64febbb1 req-cf041170-6e06-4665-8a1d-97abb05c2a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17eea1a-2a7e-4d9f-a0a3-198c91480e71", "name": "network-vif-deleted", "tag": "6d6d5ecd-8d57-4f55-8259-b5e620742bac"}]} {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:11:16.517112 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-3ef6c57e-b904-4bdb-8cc4-148b64febbb1 req-cf041170-6e06-4665-8a1d-97abb05c2a53 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:16.517570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [req-3ef6c57e-b904-4bdb-8cc4-148b64febbb1 req-cf041170-6e06-4665-8a1d-97abb05c2a53 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:16.529686 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.compute.server_external_events [req-3ef6c57e-b904-4bdb-8cc4-148b64febbb1 req-cf041170-6e06-4665-8a1d-97abb05c2a53 service nova] Creating event network-vif-deleted:6d6d5ecd-8d57-4f55-8259-b5e620742bac for instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 on hv-cinder-85068 Jul 21 21:11:16.534331 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [req-3ef6c57e-b904-4bdb-8cc4-148b64febbb1 req-cf041170-6e06-4665-8a1d-97abb05c2a53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031316 Jul 21 21:11:16.534980 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 655/1307] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:11:16.586227 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:16.586974 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:16.593710 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:16.594163 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:16.594938 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:16.595378 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:16.659245 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06aae5f002d46a3a60100c908d07455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eaf4caa6ea457bafa7de7a1387851c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:11:16.666707 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-25419370-3109-4ffc-b818-4f288e0abf74 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 200 len: 1220 microversion: 2.1 time: 0.084340 Jul 21 21:11:16.667279 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 653/1308] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:16 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:11:17.685786 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:17.686485 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] [instance: f17eea1a-2a7e-4d9f-a0a3-198c91480e71] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:11:17.692968 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:17.693459 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:17.694232 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:11:17.694677 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:11:17.708933 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] HTTP exception thrown: Instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 could not be found. Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Request method failure captured: Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 HTTP/1.1 Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-hJ3lgbvU2ObZQDuCzdtrOhPPuj26Tqe7curUomIsm83aZBP9RVZz1-pSkbt4vuFpSaLjFPN4G8VfX3Sx9cQgkkRHc6MaL5tFSjwpyqfmw4ta52ZbfINbCIzVHgXsud3HiBGkgOYzlgWw5jpz2v0r3WhLIl6dE_tb2O-1b-rTPAr8 Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 91eaf4caa6ea457bafa7de7a1387851c Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-TestShelveInstance-572548780 Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:11:17.710616 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91eaf4caa6ea457bafa7de7a1387851c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91eaf4caa6ea457bafa7de7a1387851c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91eaf4caa6ea457bafa7de7a1387851c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91eaf4caa6ea457bafa7de7a1387851c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-TestShelveInstance-572548780 Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 91eaf4caa6ea457bafa7de7a1387851c Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-TestShelveInstance-572548780 Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-TestShelveInstance-572548780-project Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: f06aae5f002d46a3a60100c908d07455 Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-TestShelveInstance-572548780-project Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 could not be found. Jul 21 21:11:17.713214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'f17eea1a-2a7e-4d9f-a0a3-198c91480e71'} Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 could not be found. Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:11:17.714317 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 could not be found. Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 could not be found. Jul 21 21:11:17.716057 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:11:17.717590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Returning 404 to user: Instance f17eea1a-2a7e-4d9f-a0a3-198c91480e71 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:11:17.717590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-bc08bdd6-2296-4fb4-94da-8e7dfc00d57e tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71" status: 404 len: 111 microversion: 2.1 time: 0.031549 Jul 21 21:11:17.717590 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 656/1309] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:11:17 2022] GET /compute/v2.1/servers/f17eea1a-2a7e-4d9f-a0a3-198c91480e71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:11:17.884799 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-40b000f7-d2e7-423c-a93c-e58a6b2e8cb0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] Calling method '.version_select at 0x7f354494f8b0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:11:17.913879 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-40b000f7-d2e7-423c-a93c-e58a6b2e8cb0 tempest-TestShelveInstance-572548780 tempest-TestShelveInstance-572548780-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1811122096" status: 202 len: 0 microversion: 2.1 time: 0.033196 Jul 21 21:11:17.914411 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 654/1310] 10.222.0.60 () {58 vars in 1253 bytes} [Thu Jul 21 21:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1811122096 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:12:22.304822 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_api:SELECT=7 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:12:22.305570 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG dbcounter [-] [124647] Writing DB stats nova_cell1:SELECT=11 {{(pid=124647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:12:22.311214 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-ebfe1d33-3a66-44e0-9275-c8d73660ffa2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:22.311730 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-ebfe1d33-3a66-44e0-9275-c8d73660ffa2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:22.319070 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ebfe1d33-3a66-44e0-9275-c8d73660ffa2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:22.319516 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ebfe1d33-3a66-44e0-9275-c8d73660ffa2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:22.320329 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ebfe1d33-3a66-44e0-9275-c8d73660ffa2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:22.320767 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-ebfe1d33-3a66-44e0-9275-c8d73660ffa2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:22.351885 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-ebfe1d33-3a66-44e0-9275-c8d73660ffa2 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/ips" status: 200 len: 149 microversion: 2.1 time: 0.048865 Jul 21 21:12:22.352479 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 657/1311] 10.222.0.60 () {58 vars in 1247 bytes} [Thu Jul 21 21:12:22 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:23.663312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:12:23.664024 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG dbcounter [-] [124646] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:12:23.669051 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-2632e164-d286-48bc-96c5-7dda2f2f31ce tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd874a5e-2489-4222-8852-7a706c33eb36"}} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:12:23.670104 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-2632e164-d286-48bc-96c5-7dda2f2f31ce tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:23.680194 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2632e164-d286-48bc-96c5-7dda2f2f31ce tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:23.680670 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2632e164-d286-48bc-96c5-7dda2f2f31ce tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:23.681415 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2632e164-d286-48bc-96c5-7dda2f2f31ce tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:23.681853 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-2632e164-d286-48bc-96c5-7dda2f2f31ce tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:23.943013 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-2632e164-d286-48bc-96c5-7dda2f2f31ce tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "POST /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281414 Jul 21 21:12:23.943834 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 655/1312] 10.222.0.60 () {60 vars in 1322 bytes} [Thu Jul 21 21:12:23 2022] POST /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:31.528506 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:31.529034 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:31.535806 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:31.536260 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:31.537029 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:31.537468 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:31.859493 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.objects.instance [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lazy-loading 'services' on Instance uuid ae70bb02-09e6-4147-a65b-9cda68d6587a {{(pid=124647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:12:31.932162 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-525b46b7-201c-41ef-865e-8d4635a0aee6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments/cd874a5e-2489-4222-8852-7a706c33eb36" status: 202 len: 0 microversion: 2.1 time: 0.407416 Jul 21 21:12:31.932753 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 658/1313] 10.222.0.60 () {58 vars in 1415 bytes} [Thu Jul 21 21:12:31 2022] DELETE /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments/cd874a5e-2489-4222-8852-7a706c33eb36 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:12:31.943569 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-59b8dc84-b09b-4807-b700-18707640b287 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:31.944781 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-59b8dc84-b09b-4807-b700-18707640b287 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:31.952489 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59b8dc84-b09b-4807-b700-18707640b287 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:31.953023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59b8dc84-b09b-4807-b700-18707640b287 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:31.953798 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59b8dc84-b09b-4807-b700-18707640b287 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:31.954233 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-59b8dc84-b09b-4807-b700-18707640b287 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:31.986896 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-59b8dc84-b09b-4807-b700-18707640b287 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048338 Jul 21 21:12:31.987588 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 656/1314] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:12:31 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:12:33.000143 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-28d2ebdf-67c4-4875-9d1b-2ee2eaf0b1d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:33.001206 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-28d2ebdf-67c4-4875-9d1b-2ee2eaf0b1d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:33.007529 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-28d2ebdf-67c4-4875-9d1b-2ee2eaf0b1d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:33.008020 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-28d2ebdf-67c4-4875-9d1b-2ee2eaf0b1d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:33.008787 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-28d2ebdf-67c4-4875-9d1b-2ee2eaf0b1d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:33.009229 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-28d2ebdf-67c4-4875-9d1b-2ee2eaf0b1d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:33.038377 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-28d2ebdf-67c4-4875-9d1b-2ee2eaf0b1d6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043626 Jul 21 21:12:33.038936 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 659/1315] 10.222.0.60 () {58 vars in 1301 bytes} [Thu Jul 21 21:12:32 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:12:33.096536 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:33.097047 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:33.103568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:33.104060 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:33.104818 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:33.105886 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:33.132112 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Going to try to terminate instance {{(pid=124646) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 21:12:33.206423 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-9306f15f-c03d-4318-b945-827e41a96063 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 204 len: 0 microversion: 2.1 time: 0.113413 Jul 21 21:12:33.207096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 657/1316] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:12:33 2022] DELETE /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 21:12:33.216937 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:33.217547 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:33.223491 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:33.223975 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:33.224727 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:33.225156 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:33.356898 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:12:33.364287 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-8970faba-65ae-4989-9dfd-0b7f7721423e tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1682 microversion: 2.1 time: 0.152370 Jul 21 21:12:33.364849 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 660/1317] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:33 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:12:34.382533 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:34.383153 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:34.390181 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:34.390635 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:34.391399 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:34.391869 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:34.643511 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.policy [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124646) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:12:34.650977 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-cbad657f-8de9-4b7c-bbe2-db296150dbf6 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1682 microversion: 2.1 time: 0.272837 Jul 21 21:12:34.651539 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 658/1318] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:34 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:12:35.668649 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:35.669256 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:35.675343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:35.675824 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:35.676591 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:35.677025 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:35.738913 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.policy [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5272710cad204a49a52116becbce6bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6549bea44b794d03bab57a0c2a001992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124647) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:12:35.746878 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-e06a0400-9a19-4805-a157-7ac9841decfa tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 200 len: 1614 microversion: 2.1 time: 0.082124 Jul 21 21:12:35.747693 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 661/1319] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:35 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:12:35.850769 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [req-d84ef608-b9d3-43ab-ae1a-c46447135bf8 req-886e7ad1-399f-4679-a0f6-530eae408e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae70bb02-09e6-4147-a65b-9cda68d6587a", "name": "network-vif-deleted", "tag": "735f011c-8535-4cce-af4f-e8eba3d772fc"}]} {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:12:35.861406 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-d84ef608-b9d3-43ab-ae1a-c46447135bf8 req-886e7ad1-399f-4679-a0f6-530eae408e88 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:35.862084 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [req-d84ef608-b9d3-43ab-ae1a-c46447135bf8 req-886e7ad1-399f-4679-a0f6-530eae408e88 service nova] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:35.874859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.compute.server_external_events [req-d84ef608-b9d3-43ab-ae1a-c46447135bf8 req-886e7ad1-399f-4679-a0f6-530eae408e88 service nova] Creating event network-vif-deleted:735f011c-8535-4cce-af4f-e8eba3d772fc for instance ae70bb02-09e6-4147-a65b-9cda68d6587a on hv-cinder-85068 Jul 21 21:12:35.880755 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [req-d84ef608-b9d3-43ab-ae1a-c46447135bf8 req-886e7ad1-399f-4679-a0f6-530eae408e88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 Jul 21 21:12:35.881631 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 659/1320] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Jul 21 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:36.764406 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:36.765053 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:36.771985 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:36.772438 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:36.773235 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:36.773672 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:36.789099 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a HTTP/1.1 Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:12:36.790771 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:36.792454 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'ae70bb02-09e6-4147-a65b-9cda68d6587a'} Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:36.794737 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:36.796254 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:36.798234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:36.798234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-d72d18e4-ecd2-49f4-9b2b-b86072bee7e9 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 404 len: 111 microversion: 2.1 time: 0.032146 Jul 21 21:12:36.798234 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 662/1321] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:36 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:36.802525 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-7ba1bffa-dd00-401b-9641-a7de426dbcd5 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '.version_select at 0x7f354029fb80>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:36.822991 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-7ba1bffa-dd00-401b-9641-a7de426dbcd5 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784773872" status: 202 len: 0 microversion: 2.1 time: 0.024556 Jul 21 21:12:36.824064 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 660/1322] 10.222.0.60 () {58 vars in 1220 bytes} [Thu Jul 21 21:12:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784773872 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 21:12:38.578071 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:38.578611 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:38.585013 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:38.585467 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:38.586227 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:38.586667 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:38.600080 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: DELETE /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a HTTP/1.1 Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:12:38.601613 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.603403 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'ae70bb02-09e6-4147-a65b-9cda68d6587a'} Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:38.604294 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.606264 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.607662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:38.607662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-48050dcc-bbb9-40b3-801c-7403f2e6827f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 404 len: 111 microversion: 2.1 time: 0.029400 Jul 21 21:12:38.607662 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 663/1323] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:12:38 2022] DELETE /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:38.612748 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:38.613484 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: ae70bb02-09e6-4147-a65b-9cda68d6587a] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:38.619684 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:38.620170 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:38.621817 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:38.622254 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:38.635830 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a HTTP/1.1 Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:12:38.637705 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.639422 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'ae70bb02-09e6-4147-a65b-9cda68d6587a'} Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:38.640445 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. Jul 21 21:12:38.642138 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:38.643579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance ae70bb02-09e6-4147-a65b-9cda68d6587a could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:38.643579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-8d437a82-a045-4c7c-ba58-32264efc2a04 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a" status: 404 len: 111 microversion: 2.1 time: 0.030687 Jul 21 21:12:38.643579 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 661/1324] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:38 2022] GET /compute/v2.1/servers/ae70bb02-09e6-4147-a65b-9cda68d6587a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:39.773573 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:39.774100 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:39.780642 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.781089 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.781848 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.782287 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.795572 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: DELETE /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 HTTP/1.1 Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:12:39.797115 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.798842 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'd0fb083e-136a-4a12-b1bb-55ceca55d399'} Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:39.799866 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.801469 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.803058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:39.803058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0586f9e5-e999-4e0b-963d-95745763e424 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 404 len: 111 microversion: 2.1 time: 0.028749 Jul 21 21:12:39.803058 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 664/1325] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:12:39 2022] DELETE /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:39.806840 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:39.807456 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: d0fb083e-136a-4a12-b1bb-55ceca55d399] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:39.814590 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.815038 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.815826 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.816261 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.832794 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 HTTP/1.1 Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:12:39.834287 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.836034 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'd0fb083e-136a-4a12-b1bb-55ceca55d399'} Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:39.837023 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. Jul 21 21:12:39.838594 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.840022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance d0fb083e-136a-4a12-b1bb-55ceca55d399 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:39.840022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-daff3611-08d4-410d-9a47-3f0844d760f3 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399" status: 404 len: 111 microversion: 2.1 time: 0.032599 Jul 21 21:12:39.840022 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 662/1326] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:39 2022] GET /compute/v2.1/servers/d0fb083e-136a-4a12-b1bb-55ceca55d399 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:39.844621 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:39.845119 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:39.851101 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.851548 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.852343 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.852781 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.866078 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: DELETE /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d HTTP/1.1 Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:12:39.867581 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.869510 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': '70f896fc-e71f-463e-b416-8f425c5ab33d'} Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:39.871114 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.872687 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.874166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:39.874166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-c4b159c0-67ec-4a21-87a0-6019c7251096 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 404 len: 111 microversion: 2.1 time: 0.028134 Jul 21 21:12:39.874166 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 665/1327] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:12:39 2022] DELETE /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:39.878297 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:39.878905 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: 70f896fc-e71f-463e-b416-8f425c5ab33d] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:39.884894 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.885341 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.886094 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:39.887169 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:39.900508 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d HTTP/1.1 Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:12:39.902091 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.904046 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': '70f896fc-e71f-463e-b416-8f425c5ab33d'} Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:39.905015 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. Jul 21 21:12:39.906330 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:39.907532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance 70f896fc-e71f-463e-b416-8f425c5ab33d could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:39.907532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-aeb178b2-0f51-4ab2-a159-abecc4e214ef tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d" status: 404 len: 111 microversion: 2.1 time: 0.028875 Jul 21 21:12:39.907532 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 663/1328] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:39 2022] GET /compute/v2.1/servers/70f896fc-e71f-463e-b416-8f425c5ab33d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 21:12:41.037299 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:41.037805 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.compute.api [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124647) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:41.044801 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:41.045257 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:41.046025 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:41.046463 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG oslo_concurrency.lockutils [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:41.059961 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.wsgi [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: request: DELETE /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 HTTP/1.1 Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept: application/json Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Accept-Encoding: identity Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Connection: close Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Length: 0 Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Content-Type: application/json Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Host: 10.222.0.60 Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Openstack-System-Scope: None Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Id: None Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Domain-Name: None Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Identity-Status: Confirmed Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Is-Admin-Project: True Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Id: default Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Domain-Name: Default Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Role: member,reader Jul 21 21:12:41.061520 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Roles: member,reader Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Id: default Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Domain-Name: Default Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: method: > Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: exception: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.063271 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: action_args: {'id': 'bbfb563f-9476-4097-bdb1-5009aa10a622'} Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:41.064305 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.065955 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.067845 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. {{(pid=124647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:41.067845 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-0b40e6c4-5a46-458b-a303-588b32c9de40 tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 404 len: 111 microversion: 2.1 time: 0.029465 Jul 21 21:12:41.067845 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 666/1329] 10.222.0.60 () {58 vars in 1238 bytes} [Thu Jul 21 21:12:41 2022] DELETE /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:41.071266 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Calling method '>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:41.071909 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.compute.api [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] [instance: bbfb563f-9476-4097-bdb1-5009aa10a622] Fetching instance by UUID {{(pid=124646) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:12:41.078908 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:41.079346 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:41.080270 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:12:41.080703 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG oslo_concurrency.lockutils [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Lock "e08105eb-bad6-485a-80ad-01afa3fd87ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:12:41.094448 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.wsgi [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] HTTP exception thrown: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Request method failure captured: Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: request: GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 HTTP/1.1 Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept: application/json Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Accept-Encoding: identity Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Connection: close Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Length: 0 Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Content-Type: application/json Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Host: 10.222.0.60 Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Openstack-System-Scope: None Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: User-Agent: python-urllib3/1.26.9 Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Auth-Token: gAAAAABi2b-OVg6bktrvnOGEtbejXKaaHlnkcdHTTTEnOyRn-8AquGiJY8k1tos_39eEUuk1H9rtNtaslJnoteofLWnF8BbXPFJcZhGeNEOZ1oTx9R2G5V5EVwSzSMDx4AyTIXjtNSiilQBlpjT7XTez6CQqXPTNh5h8n8y3vykKJQBt0H5RYVs Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Id: None Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Domain-Name: None Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Identity-Status: Confirmed Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Is-Admin-Project: True Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Id: default Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Domain-Name: Default Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Project-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Role: member,reader Jul 21 21:12:41.096096 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Roles: member,reader Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6549bea44b794d03bab57a0c2a001992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6549bea44b794d03bab57a0c2a001992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Id: 6549bea44b794d03bab57a0c2a001992 Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373153454 Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Id: default Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Domain-Name: Default Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Id: 5272710cad204a49a52116becbce6bc1 Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: X-User-Name: tempest-AttachVolumeNegativeTest-373153454-project Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: method: > Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: exception: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.097746 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: action_args: {'id': 'bbfb563f-9476-4097-bdb1-5009aa10a622'} Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:12:41.098614 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. Jul 21 21:12:41.099989 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: ERROR nova.api.openstack.wsgi Jul 21 21:12:41.101201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] Returning 404 to user: Instance bbfb563f-9476-4097-bdb1-5009aa10a622 could not be found. {{(pid=124646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:12:41.101201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b79ceef2-321e-4da0-aaaa-a4877aee2e7f tempest-AttachVolumeNegativeTest-373153454 tempest-AttachVolumeNegativeTest-373153454-project] 10.222.0.60 "GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622" status: 404 len: 111 microversion: 2.1 time: 0.029990 Jul 21 21:12:41.101201 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 664/1330] 10.222.0.60 () {58 vars in 1235 bytes} [Thu Jul 21 21:12:41 2022] GET /compute/v2.1/servers/bbfb563f-9476-4097-bdb1-5009aa10a622 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:12:46.970476 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-07b3f58d-5db4-4569-81bb-d731dc68d943 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f3540b393a0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:47.019364 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-07b3f58d-5db4-4569-81bb-d731dc68d943 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/329a1fd3-401f-40af-9916-d91e88a6e687" status: 200 len: 351 microversion: 2.1 time: 0.052625 Jul 21 21:12:47.020074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 667/1331] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:12:46 2022] GET /compute/v2.1/os-volumes/329a1fd3-401f-40af-9916-d91e88a6e687 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:48.329312 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-efdf7b40-4616-4771-934d-4d3c8f3ef7d7 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f354492b280>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:48.375257 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-efdf7b40-4616-4771-934d-4d3c8f3ef7d7 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/092c614c-4822-4634-8a2e-b6d6220d4149" status: 200 len: 350 microversion: 2.1 time: 0.050169 Jul 21 21:12:48.375847 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 665/1332] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:12:48 2022] GET /compute/v2.1/os-volumes/092c614c-4822-4634-8a2e-b6d6220d4149 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:49.689595 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-24fe1d5a-fc79-4b93-9f09-70b146cab2eb tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f3540e22040>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:49.735165 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-24fe1d5a-fc79-4b93-9f09-70b146cab2eb tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/44fed8f9-f506-416e-9eb6-4041187ef73e" status: 200 len: 351 microversion: 2.1 time: 0.049798 Jul 21 21:12:49.735765 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 668/1333] 10.222.0.60 () {58 vars in 1244 bytes} [Thu Jul 21 21:12:49 2022] GET /compute/v2.1/os-volumes/44fed8f9-f506-416e-9eb6-4041187ef73e => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:49.747823 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-b716d46a-5ab5-478f-a121-e8511a49e08c tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f354494f5e0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:49.825584 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-b716d46a-5ab5-478f-a121-e8511a49e08c tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081913 Jul 21 21:12:49.826149 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 666/1334] 10.222.0.60 () {58 vars in 1133 bytes} [Thu Jul 21 21:12:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:12:49.837947 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-140941ff-e9d8-46e8-bb81-01a5aa95522e tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f3540173940>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:49.918774 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-140941ff-e9d8-46e8-bb81-01a5aa95522e tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084396 Jul 21 21:12:49.919464 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 669/1335] 10.222.0.60 () {58 vars in 1148 bytes} [Thu Jul 21 21:12:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:49.930904 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-5dbaa8a1-a88c-46d8-9fe7-5bb17d01da9e tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f3544a33280>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:50.011596 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-5dbaa8a1-a88c-46d8-9fe7-5bb17d01da9e tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084342 Jul 21 21:12:50.012757 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 667/1336] 10.222.0.60 () {58 vars in 1133 bytes} [Thu Jul 21 21:12:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:12:50.023871 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-dee8dabb-da2e-4707-8b48-2f56c76cab8a tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f3540dcd5e0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:50.103483 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-dee8dabb-da2e-4707-8b48-2f56c76cab8a tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083279 Jul 21 21:12:50.104091 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 670/1337] 10.222.0.60 () {58 vars in 1166 bytes} [Thu Jul 21 21:12:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:50.115530 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-41d8f610-21ec-4b5a-9384-c74c96e4aa7a tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f35449073a0>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:50.199859 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-41d8f610-21ec-4b5a-9384-c74c96e4aa7a tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087966 Jul 21 21:12:50.200573 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 668/1338] 10.222.0.60 () {58 vars in 1169 bytes} [Thu Jul 21 21:12:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:50.212268 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-62be1514-5566-4290-92c5-10c6e1da6d01 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f3540b18ee0>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:50.292244 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-62be1514-5566-4290-92c5-10c6e1da6d01 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083608 Jul 21 21:12:50.292820 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 671/1339] 10.222.0.60 () {58 vars in 1154 bytes} [Thu Jul 21 21:12:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:12:50.304568 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: DEBUG nova.api.openstack.wsgi [None req-55d638a6-6f98-4b54-b269-476dfa6a273b tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f354032c280>' {{(pid=124646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:50.385340 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO nova.api.openstack.requestlog [None req-55d638a6-6f98-4b54-b269-476dfa6a273b tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084424 Jul 21 21:12:50.385983 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: [pid: 124646|app: 0|req: 669/1340] 10.222.0.60 () {58 vars in 1187 bytes} [Thu Jul 21 21:12:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:12:50.397846 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: DEBUG nova.api.openstack.wsgi [None req-5c9c3c3f-7150-4f72-b7cd-12278575a7d8 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] Calling method '.version_select at 0x7f3540173820>' {{(pid=124647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:12:50.483074 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO nova.api.openstack.requestlog [None req-5c9c3c3f-7150-4f72-b7cd-12278575a7d8 tempest-VolumesTestJSON-1383594000 tempest-VolumesTestJSON-1383594000-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088847 Jul 21 21:12:50.483683 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: [pid: 124647|app: 0|req: 672/1341] 10.222.0.60 () {58 vars in 1154 bytes} [Thu Jul 21 21:12:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:14:58.447402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:14:58.447905 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Thu Jul 21 21:14:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:16:02.606245 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:16:02.606828 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 21:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:16:19.372441 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:16:19.373187 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 21:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:17:44.560857 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:17:44.561439 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Thu Jul 21 21:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:18:17.164741 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:18:17.165197 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 21:18:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:18:18.456849 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:18:18.457417 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Thu Jul 21 21:18:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:18:23.312402 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:18:23.313053 dv-cinder-850687-1-iscsi devstack@n-api.service[124646]: Thu Jul 21 21:18:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:19:22.614582 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:19:22.615157 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 21:19:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 21:19:39.381551 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 21:19:39.382191 dv-cinder-850687-1-iscsi devstack@n-api.service[124647]: Thu Jul 21 21:19:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!